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ABSTRACT 

This workshop leader's guide is designed to assist 
Technical Assistance Center staff memjt«ers and other Inservice 
providers in conducting successful workshops on reading assessment 
for teachers, administrators, and others associated with Chapter 1 
prc^rams. The guide contains step-by-step procedures for preparing, 
organizing, and presenting a one- to three-hour workshop. Sections of 
the guide are entitled: (1) Getting Started (including an advance 
planner and a detailed checklist of the materials and equipment 
needed for the workshop); (2) Presenter's Guide (with detailed 
Instructions for a one-hour workshop) ; (3) Transparency Masi.ars; (4) 
Handout Masters; (5) Bibliography (a 127-item selected bibliography 
on reading assessment); and (6) Background Information (reprints of 
pertinent journal articles). (RS) 
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Evaluation of Workshop Leader's Guide 
Reading Assessment: How do we measure understanding? 

Directions: Please tell us how you used this Workshop Leader's Guide and how well it met your nseds. 
PARTI: USER INFORMATION 
Your affiliation is wilh: T AC R-TAC _ 



PLEASE 
COMPLETE 
AFTER 1st 
USE! 



FE I 
St [ 

y 



Your level of prior knowledge of this u^ic topic was: 



.SEAAXA Other (please specify): 

high medium low 



Check all of the blanks that (tescribe yCHir use oS the guide: 

10 research a topic jnesented wilh no changes 

to prepare a workshop presentation presoitcd with few changes 

other (please sj^ify); presented with many changes 



Clients 

LEA 

SEA 

Other (please specify): 



Place a check in front of each section of the guide you used (some guides will not have all the sections listed): 

Presenter's Guide Transparency Master Handout MastCTS Background Paper 

Support Articles Support Activities Biblipgraphy 



To your clients, you distributed copies of: 

Presenter's Guide Transparencies Handouts 



. Other (please j^Kxify): 



ERLC 



PART II: CONTEIVT 

The balance between theory and application in the guide was: 

good poor (too little theory) poor (too little ajylication) 

The scope of the guide was: apprqjriate too broad too specific 

The material in the guide was: timely dated too innovative 

For my audience(s), the content was: just right over their beads too rudimentary 

If you or your audience found anything inappropriate in the guide, check the category and specify the problem and where 
it occurs: gender race ethnic age regional other (please specify): 



PART in: DESIGN 

Theorganizationof the guide was: saUsfactory unsatisfactory (please specify): 

The graphics on the masters: reinforced content disffacted from content 

The quality of copies produced from the masters was: satisfactory __unsatisfaciory (please specify); 



Ptease write additional comments or suggestions at the top of the reverse side of this form. Fold the form so the 
comments are on the inside before mailing. THANK YOU! 
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Additional Comments & Suggestions: 




Chapter 1 Curriculum & Instruction Center 
PRC, Inc. 

2601 Fortune Circle Drive East, Suite 300A 
Indianapolis, IN 46241 
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Curriculum & Instruction, Region B Technical Assistance Center, under 
Contract No. LC88023002 with the US. Department of Education. Any 
findings, opinions, conclusions, or recommendations expressed in this 
publication are those of the authors and do not necessarily reflect the 
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Getting Started 

What's in this Guide? 

This Workshop Leader's Guide is designed to assist Technical Assistance Center staff members and 
other inservice providers in conducting successful workshops on reading assessment for teachers, 
administrators, and others associated with Chapter 1 programs. This guide contains step-by- step 
procedures for preparing, organizing, and presenting a one- to three-hour workshop. 



Contents: 



Section 1, Getting Started, includes an Advance Planner and a detailed checklist for the materials and 
equipment needed to conduct a successful workshop on reading assessment. It also includes suggestions 
for conducting the workshop evaluation. 

Section 2, the Presenter's Guide, includes detailed instructions for presenting a one-hour workshop 
including the goals of the workshop, specific activities, and recommendations for using the overhead 
transparencies and participant handouts. The outline for the one-hour workshop can be expanded with 
the handouts to provide the basis for a workshop up to three or more hours in length. 

Section 3 contains the blackline masters for the overhead Transparencies referred lo in the 
Presenter's Guide. 

Section 4 contains the blackline masters for the Handouts referred to in the Presenter's Guide. 

Section 5 contains a Bibliography of additional sources of infonnation. 

Section 6 contains Background Information to supplement the Presenter's Guide. 



How to Use this Guide 

This Guide contains the planning and presentation materials necessary to conduct a successful 
workshop on reading assessment. The materials were developed to allow a great deal of flexibility. 
Suggestions for workshop variations and a variety of activities are included so that the workshop can 
be adjusted to fit the needs and backgrounds of the participants. A wide range of approaches, types 
of activities, and specific research can be used in the acmal workshop presentation. You may choose 
to change, add, or eliminate an activity or transparency. The sections in the Presenter's Guide are well 
suited for expansion or contraction, depending upon your presentation needs. Special noies and user 
instructions appear in boxes throughout the Guide. 
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Planning the Workshop 

Begin your advance planning for the workshop by establishing some of the initial details, such items &s 
date, place, and type of audience. (Sec Advance Planner, a simple checklist for planning a workshop, 
p.4.) Begin studying the contents of this guide by following the C-U'l-D-E steps outlined below: 
Glance, Understand^ Investigate, Develop^ and E(U:. 



• Glance through the entire set of materials. 

This will give you a feel for the types of 
inaterials contained in the Guide (and their 
location) when you study the details later. 

• Vnderstands&nany of itit materials contained 

in the Guide as possible. Plan enough time 
to develop a full grasp of the materials in order 
to make more inforaied decisions about 
your workshop presentation. 

• investigate further. You may want to do 

additional research, try different problems, 
or experiment with various activities. 

• Develop additional materials. These may be 

workshop notes, transparencies, handout pages, 
activities, or any item resulting from your 
"investigating" activities. 

• Edit, Look carefully at the total picture, 

then elaborate or eliminate where necessary. 



Ptfgin planning as soon as possible. Even if you use only the materials in this Guide, the G-U-I-D-E 
steps will take time and should be included in your planning. It is especially imponant to allow yourself 
the opponunity to thoioughly explore and review the activities in the Presenter's Guide so the purpose 
and strategies for each activity will become more apparent to you. In addition, as you engage in the 
activities, you are likely to discover that you need or want to try additional activities from several sources. 
(See Section 5, Bibliography for additional ideas.) You may find that these materials are better suited 
to your particular workshop and, therefore, you may want to substitute them for the workshop materials 
specified in the Presenter's Guide. 
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What You Need for the Workshop: 



EQUIPMENT 



MATERIALS 



Overhead Transparency Projector 

extension cord 

plug adaptor 

extra bulb or spare projector 

Blank Overhead Transparencies 
pens for marking on transparencies 

Screen 

Microphone (if needed) 



Presenter's Guide 
Your Supporting Notes 

Overhead Transparencies 

(prepared from transparency 
masters in Section 3) 

Participant Handouts 

(one from Section 4 for 
each participant) 



SUPPORT MATERIALS 

Chart paper and/or poster board 

Markers and tape (or chalkboard and chalk) 



Props for demonstrations or activities 



Before You Begin 

Make copies of the overhead transparencies you plan to use in the workshop, and 
be sure you have one copy of the handouts for each participant. If you are presenting 
the workshop in a location with which you are unfamiliar, ask the local contact person 
to be sure the equipment listed above is available and in working order on the scheduled 
day and time of the workshop. If you will be supplying your own equipment, make ar- 
rangements for obtaining it well in advance of the workshop and make sure everything is 
in working order. 
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Workshop Advance Planner 



Presentation Information 



Title. 



Date 



Day 



Place 



Audience Type 
Purpose 



y^ontact Person, 



Time 



Number 



Phone 



Planning Task 



Notation 



Date 
Completed 



Contact Person(s) for Planning 
Confirm Date, Time & Place 
Make Travel and Hotel Plans 
Arrange for Equipment 
Send Woricshop Agenda to Contact 
Personalize Workshop Outline 
Other 
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Reading Assessment: 
How do we measure understanding? 

Workshop Outline 



Activating Prior Knowledge/ 


10-15 minutes 


Providing Background Information 




New Directions in Reading Assessment 


10-15 minutes 


Promising Practices and 


30-45 minutes 


Applications for Chapter 1 




Conclusion and Evaluation 


10-15 minutes 



(Please note: While this workshop can be used for a one to one-and-a-half-hour 
presentation, there is enough material to extend it easily to two or even three 
hours by giving participants opponunities to work with the assessment measures 
described in the handouts.) 
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Workshop Evaluation 




Workshop Leader's Guide 
Evaluation 

It is impanant for us to know how well the 
various pans of the Workshop Leader's Guide 
worked for you and to receive your suggestions 
of ways to improve future workshops. Please 
take one of the evaluation forms we have 
put in the pocket just inside the cover of this 
binder (the form is illustrated on the right). 

Please note your reactions as you review the 
materials in the Guide prior to your presentation. 
Complete the form as soon after your first pre- 
sentation as possible. Fold the form so your 
written comments are covered, staple or tape 
the packet closed, stamp, and mail. 



Workshop Evaluation 

In the Presenter's Guide, we suggest you take 
the last few minutes to conduct your workshop 
evaluation. The choice of method and instru- 
mentation is yours. In the handout section, we 
have included a sample of the form currently 
used by Region B TAG and Region 2 R-TAC 
(the form is illustrated on the left). Whatever 
basic form you use, we recommend you supple- 
ment it with questions related to your specific 
goals and audience. 

If you receive specific comments about the 
materials from this Guide (i.e., transparencies, 
handouts, content used from the presenter's 
guide), please include a brief summary 
on your Workshop Leader's Guide Evaluation. 
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READING ASSESSMENT: HOW DO WE MEASURE 

UNDERSTANDING? 



Reading Assesnnent: 
Haw do we measure 
understanding? 





Display T-1 - "Reading Assessment: How do we 
measure understanding?" 



Starter Activity: "Test!" 
(Activating Prior Knowledge) 

Think of the word "Test!" 

What comes to mind? Share your thoughts with the person 
sitting next to you. Can you remember an important test you 
have taken? Do you remember taking any reflJin^ kj«s? How 
old were you? How did you feel? Who was testing you? Why 
were you being tested? 

After exchanging infomMtion with each other, share your 
experiences with the group. [You may want to make this a 
Imnstorming activity and use semantic maps (see Handout 
H22) to organize the information volunteered. This way you 
can model the use of some alternative assessment strategies 
during the woikshop. Try to elicit all kinds of reactions, 
including emotional, educational, and philosophical to the idea 
of reading tests.] 

Now - I'm going to give you all a test right now on your 
reading ability. How do you feel? (Possibly smug? Compla- 
cent? Confident? Woiricd? Nervous?) You may exhibit a 
range of emotions, but virtually all of you are fluent readers 
and so should have littic to worry about. 



Display T-2 ~ "Chinese Text" 



However, if I show you this text in Chirwse and ask you to read 
it and be prepared to explain its meaning to the group, can any 
of you do it? What if I give you more time to study it? 
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Dbplay T-3 - "Arabic Text" 



If I show you this i«ading passage in Arabic {from the Komn), 
can you do any better? You might complain that this test is 
unfair - that it is not a true measure of your reading abilities, 
since you have not had a chance to leam to read Chinese or 
Arabic. 



Display T-4 "Mirror-Image Text" 



What if I show you a text in English from an address by the 
President of the United States, but show you the passage in 
mirror-imagel (Leonardo da Vinci is said to have written all 
of his journals in minor-image text) All of the letters and 
words are exactly the same, but you are seeing them written 
backwards. Is this test a fair assessment of your abilities? Can 
someone volunteer to read the first sentence aloud? 

How do you feel now? Mad? Upset? Challenged? Intrigued? 
What if I show you this next passage? 



ERIC 
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Display T-5 "'Computerese' English" 



This is written in English, but many of you might have diffi- 
culty explaining its n^aning, and your test score might well be 
below the true level of your reading ability. 

What do reading tests measure? Your ability to decode and 
pronounce words accurately? Your ability to xead with flu- 
ency? Your ability to und^tand the meaning of what was 
read? How important is context? Prior knowledge? 

As part of their effective schools or educational reform initia- 
tives, several states have adopted an "official definition" of 
reading based on current research. For example, as part of the 
1985 Illinois Legislative Reform Act, the state adopted this 
definition (Assessing reading in Illinois, 1989): 



Display T-6 "Interaction of Reader, Text« and Context" 











Innuendng Factors 








■ lexi ■ CniuvM 1 








Meaning 









"Reading is the process of constructing meaning 
through the dynamic (eva-'Changing) interaction of the 
reader, the text (written material), and the context of 
the reading situation." 

• The reader brings to the process his or her abilities, 
prior knowledge, motivation, interest, attitudes, 
and expectations. The ^xt presents illustrations and 
foimat. The context varies by the task and the 
intended uses of the infomoation. 

• The emphasis in this current view of reading on the 
interaction of these components contrasts with the 
traditional view as taught for the last 30-50 years. 



This traditional view of reading focused on a "skills approach" 
which began with a heavy concentration on word recognition 
skills (e.g., phonics, sight words, structural analysis) and 
stressed comprehension only after students deooonstrated 
competence at the literal level. The underiying supposition of 
the skills tnodel is onv of building blocks; the reader must 
acquire "lower level' ' kills before being able to handle more 
"advanced" skills. When a student acquires all of the skills, he/ 
she is a "proficient reader." However, the fallacy in this suppo- 
sition became apparent when teachers observed students who 
could perform skills well in isolation, yet still not read with 
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Interaction of Reader, Text, and Context (cont.) 

comprehension. Or, they observed students who did poorly on 
isolated sidll exercises* yet could still xead with fairly good 
comprehension when reading ^ords in context Frequently, in- 
struction for beginning readers has bogged down in an empha- 
sis on word recognition and literal comprehension, leading to 
student misconceptions about the reading process as being the 
mere sounding out of words. 

Purpose of Testing 



Display T-?--** Reading Asse^ment Questions** 



Why do we test children in reading? What are we trying to 
And out? What inframation is most useful to us? How can we 
best communicate this information to students, teachers, par- 
ents, and other external decision makers? 

What are standardized reading tests like today for children? 
[Discuss the kinds of information the audience supplies as well 
as noting any gaps in the information.] 

[You may want to list or create a semantic map of responses on 
a blank transparency as the group discusses them. When you 
ask what reading tests typically look like, you may get answers 
that describe a "reading passage followed by multiple choice 
literal recall questions," but you may also get descriptions of 
cloze procedures which involve words deleted from a passage. 
Informal Reading Inventories, or other types of assessment. 
This discussion should not extend much beyond 5 or 10 min- 
utes. If individuals bring up more recent evaluation procedures 
such as the Michigan Assessment (see Appendix A, p. 15) or 
performance assessment, explain that you're still reviewing 
procedures commonly used prior to more recent trends. 

Participants may note several gaps in information supplied by 
standardized tests. Possible gaps may include these items and 
more: 

• they fail to supply us with any products created by 
chiMren; 

• they don't show what children can accomplish given 
longer periods of time to complete a task; 

• they don't use real problems or materials; instead they 
use artificial or contrived events; 
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Reading Assessment Questions (cont.) 

• they don't supply specific information about improvement in 
abilities over time - the quality of understanding vereus the 
quantity^ or depth of information versus t»eadth; 

• a nanDw sample is used to assess learning over large amounts 
of infonxiation; 

• there is no opportunity for students to explain the reasoning 
behind their answers; 

• children may be tested on infonnation to which they have not 
yet been exposed or had a chance to learn; 

• no student self-assessments are included. 



Optional Activity 

Show examples of test questions from a variety of standardized tests, such as: 

California Achievement Test (CAT) 
Comprehensive Test of Basic Skills (CTBS) 
Iowa Tests of Basic Skills (ITBS) 
Metropolitan Achievement Test (MAT) 
Stanford Achievement Test (SAT) 

or other more informal assessment instruments: 

Degrees of Reading Power 
Ooze Tests 

Informal Reading Inventories 

Examine the kinds of information measured via th<;se test questions, e.g., 
literal, recognition or recall, definitions, generalizations, value judgments, 
interpretations, application of information, analyses, syntheses, evaluation.] 
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Summary 

To sum up "where we've been" in assessment: 

1 . Standardized tests of reading almost always break reading down into 
subparts -- wwd recognition, vocabulary, and reading comprehension. 
Although most reading experts and many teachers would agree that 
vocabulary and (especially) comprehension are the better indicators of 
students' reading ability, it would be difficult to sell a test without 
subtests on word recognition. 

2. Subtests on reading comprehension almost always arc comprised of 
short passages followed by questions. The majority of the questions 
have always been literal recall, although more and more often, they 
include questions requiring inference or other critical reading strate- 
gies. Despite this, it has not been possible with any of the tests to 
separate out enough higher order questions to get a separate higher 
order thinking score. 

3. Degrees of Reading Power (published by The College Boaid, New 
York) presents one example of a different ^proach on a standardized 
test of reading comprehension. Each DRP test consists of a number of 
prose passages based on nonfiction subjects. Students are expected to 
read the passages and supply missing words from five choices. Sev- 
eral sequential sentences are given before a deletion. Choices are all 
semantically plausible and syntactically correct, so the student must 
understand the material to make a corrrct selection. This test offers 
some advantages over other types of tests, but it has never really 
"caught fire" as the way to test reading comprehension. 

4. The cloze procedure has been used informally to assess reading com- 
prehension because the research has demonstrated that it assesses 
compia^ension about as well as an Informal Reading Inventory (IRI), 
and one can generate independent, instructional, and frustration 
reading levels for a student as you do with an IRI. Cloze has the 
advantage that it is quite easy to develop, administer to a group, and 
score. [SeeH12] 

5. Informal Reading Inventories (published and informally developed) 
have been used for decades to assess students' reading ability. As with 
the cloze procedure, the limitation is that they are designed to obtain 
an appropriate reading level for students, not to diagnose strengths and 
weaknesses or to determine a given student's repertoire of reading 
comprehension strategies. 
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Reading Assessment and the National Education Goats 

Reading Assessment takes on an even more imjxntant role as states and local 
school systems begin implementing the new America 200O strategies to work 
toward meeting the National Education Goals for the year 2000. These goals 
call for better and more accountable schools for students. Through an "ac- 
countability package, parent;, teachers, schools, and communities can all be 
encouraged to measure results, compare results, and insist on change when the 
results aren't good enough" {America 2000. 1991, p. 21). 



A National Education Goals Panel is developing standards for each of the five 
core subject areas, including reading (English). As slated in the National 
Education Goals, "achievement tests must not simply measure minimum 
competencies, but also higher levels for reading, writing, speaking, reasoning, 
and problem- solving skills." {America 2000, 1991, p. 71). 

To summarize: Over the years, researchers and test makers have continually 
sought more valid and useful ways to assess reading comprehension, most 
commonly by using commercially-published standardized tests. With the 
strong emphasis today on educational accountability and talk of a national 
test, reading programs will probably still include some use of standardized 
tests, because they do have some definite advantages. 

• They are relatively inexpensive; 

• they are easy to administer to large groups of students at a 
time; 

• they can be machine-scored in an objective fashion; 

• they have been checked for validity and reliability; 

• they supply normative data allowing comparisons between 
children, schools, and states. 

New Directions In Reading Assessment 

Despite some advantages, however, reading researchers and others are clearly 
becoming dissatisfied with the lack of instructional insights that can be 
gained from typical standardized tests. 
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Display T-8 - ** Becoming a Sation of Readers Quote" 



As siaicd in Becoming a Nation of Readers , 

"Standardized tests of reading comprehension mani- 
festly do not measure everything required to understand 
and appreciate a novel, learn f^rni a science textbook, 
or And items in a catalogue" (Anderson, Heibert, Scott, 
& Wilkinson, 1985, p. 94) 



Display T-9 - ''Means & Knapp Quote #1" 



More recently, in the PSA/SRI report on Teaching Advanced 
Skills to Educationally Disadvantaged Students, Means & 
Knapp (1991, p. 4) noted, 

"The difficulty in measuring meaningful higher-order 
taf Ks with economical paper<and-penci! measures has 
led to an emphasis on measuring discrete components 
of complex tasks rather than t ; ta sks themselves. ' 

Means & Knapp went on to point out that children can learn to 
reason about new information, relate information from differ- 
ent sources, ask questions, and summarize using orally pre- 
sented text, "Research demonstrates quite clearly that students 
can acquire these comprehension skills - which we have 
traditionally called advanced well before they are good 
decoders of the printed word/' 

However, disadvantaged students often do not receive much in- 
struction in higher-order skills compared to their peers (Means 
& Knapp, 1991; AUington & McGill-Franzen, 1989; Oakes, 
1986). Teachers are often more directive with them, breaking 
complex tasks down into smaller pieces for them, guiding them 
through problems stcp-by-^tep, "and in general, giving them 
less exposure to problem-solving tasks in which there is more 
than one possible answer and in which they have to structure 
the problem for them-Jdves" (Anyon, 1980). 
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Means & Knapp reiterated the 1990 findings of Knapp & Turn- 
bull and concluded that these teaching practices, as well as the 
use of assessment measures focused on mastery of basic 
skills tend to: 

• underestimate what disadvantaged students axe 
capable of doing; 

• postpone more challenging and interesting work 
for too long ~ in some cases, forever, and 

• deprive snidents of a meaningful or nootivating 
context for learning or for using the skills that 
arc taught (Means & Knapp, 1991, p. 3). 



What We've Learned About Reading 

Cunent research focuses on reading as a constructive process 
requiring the interaction of the reader and the text in a specific 
context. This process is affected by the nature of the reading 
task and the characteristics of the text as well as the reader's 
abilities and prior knowledge. Recent instructional changes 
now treat reading as a stxategic process rather than an accumu- 
lation of subskills. Reading assessment (and sometimes read- 
ing instruction) as practiced in many Chapter 1 programs has 
not always reflected these trends. 

[Summarize this %ction by discussing the fact that the recent 
research and thinking on reading comprehension has led to a 
reconsideration of methods used to assess reading, but changes 
have not been rapid. 

Refer participants to the chan (HI), "A set of contrasts be- 
tween new views of reading and current practices in assessing 
reading." 

Note that the publication, Reexarmning Reading Diagnosis: 
New Trends and Procedures (Glazer, Searfoss, & Gentile, 
1988), also exemplifies efforts to apply the new research to 
reading assessment techniques.] 
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Promising Practices and Applications 

Since the foiroal reading tests currently available do not supply all of the 
infoimation needed to accurately assess children's reading ability, we need to 
supplement these tests with new types of information that more closely match 
the instruction that children arc receiving today. Few example, when children 
are not drilled on individual isolated letter-sound associations or on syllabica- 
tion skills, but are still given tests to measure their proficiency on these 
subskill tasks, there is a mismatch between instruction and assessment 

Alternative reading assessment starts with a different focus. Instead of focus- 
ing on a list of basic skills that all children should know and administering 
formal standardized tests that provkie information about children's deficits, al- 
ternative methods of assessment have a broader frame. They include infomia- 
tion about children's areas of strength and the impressive intellectual accom- 
plishments they have already achieved in addition to noting specific areas of 
weakness that need further attention. 

The early accomplishments that all children, including the disadvantaged, 
have achieved before entering school demonstrates to the children, the par- 
ents, and the teachers that all of the pupils are capable of doing serious intel- 
lectual work and are capable of becoming good readers. The fact that some 
children have had more prior exposure to literacy experiences does not mean 
that the other children are "dumb" or "slow", but merely that they haven't had 
as much practice ycL (Just as most of you had not had much practice in read- 
ing Chinese, Arabic, or even minor-image text. However, given the opportu- 
nity and motivation, I'm sure all of you could eventually leam to read those 
passages.) Instructional methods that build on children's prior learning and 
experiences outside of school can also be assessed using new methods. 

Teaching and assessing children's ability to perform both basic and advanced 
skills in real-world contexts makes the skills meaningful and available to the 
students for use in other, similar simations. They have immediate relevancy 
to their lives. Learning becomes a process of knowledge sharing. Teachers 
can provide smdents with authentic, complex tasks while supplying cues, 
prompts, and scaffolding to facilitate their success. 

Often, teachers have lowered expectations regarding disadvantaged children's 
capabilities due to the limited background experiences they bring to school. 
Other teachers believe that these students can't do advanced skills unless they 
first master all of the basics. Alternative assessments can provide teachers 
with information that demonstrates what children can do, given the opportu- 
nity and some assistance. [See H2 for an overview of altemarive assessment. 
You might also want to discuss the Michigan Essential Skills Reading Test 
(Appendix A, p. 15) as an example of new standardized testing formats.] 
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Promising Practices and Applications (cont) 

The trend today i$ for teachers to integrate assessment with 
instruction in the form of more perfoimance-baKd measures of 
students' reading abilities that can be used to supplement the 
infonnation provided by standardized tests. This can include a 
variety of measures that can be used before, during, and after 
reading. [Refer to the chart, H4, on integrated instruction and 
assessment. ] 



Display T-11 [H4}- "Integrating . . . . " 



The alternative assessment measures described in the 
handouts of this workshop are integrated with instruc- 
tional strategies. In addition, they are ongoing and 
dynamic, they measure process, they are based on 
reading tasks using actual classroom materials, they 
identify student strengths as well as instructional needs, 
they are often teacher constructed and/or conducted, 
they stress the use of multiple tools, environments, 
strategies, and texts, and they incorporate and develop 
student self>evaluation. 



Demonstrations 

[Choose one or more strategies from each phase before, during, 
and (tfter reading, Hs S-24, to demonstrate in some depth how 
the technique can be used for assessment purposes as well as 
instruction. Use any relevant transparencies T-14 to T-29 to 
illustrate the assessment techniques. 

For assessment Before Reading, you might refer to the handout 
on: 

• K-W-L (Know-Want-Leam); Focus on how 
information derived from the "what we already 
know" and "what we want to find out steps" can 
be used to assess the degree of background in- 
fonnation students arc bringing to the task as 
well as any major bits of misinformation they 
may exhibit This assessment information can 
guide the teacher's further instruction. 
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Demonstrations (cont.) 

For assessment During Reading, you might demonstrate the use of: 

• think alouds to assess students' awareness and use of informa- 
tion regarding text structure, or you might demonstrate the 
use of Cornell or Herringbone Notetaking Systems and then let 
the paiticipanis apply their knowledge for the rest of the 
session. 

For assessment After Reading, you might go over the handout on: 

the use of multi-level questioning techniques or story retelling 
as ways to assess reading proficiency. 

Feel free to select any handout you wish to from among the selections pro- 
vided.] 

Portfolio Assessment 

One of the most-discussed new trends in reading assessment today is the use 
of portfolios. Portfolio assessment can include a variety of measures demon- 
strating what a child has been able to achieve in the area of reading over a 
period of time, including the component of student self-assesment of reading 
abilities. Portfolio assessment: 

• allows for ongoing assessment over a period of time; 

involves natmal rather than artificially contrived literacy behaviors; 

• assesses the child in context; 

• can be unobtrusive; 

• relates assessment closely to instructional goals; 

broadens the scope of procedures and materials used to assess reading 
proficiency; 

• promotes an active self-assessment role for students. 

However, we need to remember thai just because something is a new and 
alternative form of assessment, does not make it automatically better. Portfo- 
lio assessment and other forms of alternative assessment can be misleading if 
misused and can present a false picture of children's learning if they are not 
representative or do not include consistent informadon across children, i.e., 
teachers can have strong biases and may interpret the same comments of two 
children very differently. However, if used effectively, portfolio assessment 
can provide helpful information. [See H3] 

Question: Are all norm-referenced, multiple choice tests bad? 
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Portfolio Assessment (cont.) 
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No. They can supply some valid and reliable infonnation thai 
can be of value to teachers and others. But, ordinarily, the 
infonnation supplied by these tests may be too narrow to 
supply any useiful instructional infc^naation and thus needs to 
be supplemented with oth«- sources of infonnation. Alterna- 
tive nKxles of reading assessment can enrich and expand the 
kinds of infonnation gathered about what a child has learned 
about reading in order to better help our Chapter 1 children 
learn not only more effective reading strategics, but also gain 
greater self-confidence, perseverance, and njotivation to con- 
tinue reading throughout their lives. 

Conclusion and Evaluation 

To improve your Chapter 1 reading program, it is helpful to 
note current research findings and to review what implications 
these "effective practices" can have for integrating assessment 
into your instructional trading program. 



Closing Activity [Use "Reading Program Assessment- Two 
Steps," H25] 




Display T-12 and T*13~ ^'Reading Program Assessment" 



Step One! What should we be doing? 

Form small groups to brainstorm both instructional and assess- 
ment implications of what research says are effective practices. 

Step Two: What are we doing? 

Individually rate your own reading program. If there are others 
from your school, compare notes to discover areas of strength 
and areas in need of further program improvement Review 
and summarize final points concerning traditional and alterna- 
tive methods of assessing reading. 



[Following debriefing, hand out evaluation forms (H26 or your 
own alternative) to assess your presentation.] 
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APPENDIX A 



Information R egarding the Michigan Essential Skilk Rpariinp Test 

The Michigan Essential Skills Reading Test (MESRT) uses intact, full-length 
stories and subject area reading selections taken from real materials in the 
environment, such as children's magazines, litaature anthologies, and text- 
books for different grade levels. The test focuses on the interaction among 
reader, text, and context TTie test uses three types of items for measuring 
"constructing meaning" abilities; 

1. intersentence items, in which the answer to the test item can be found 
in two to three contiguous sentences in the reading selection; 

2. test items, in which one or more paragraphs of the reading selection 
must be read in order to (instruct meaning; and 

3. "beyond the test" items, in which the reader not only constructs mean- 
ing from the text, but musr also add some information from his/her 
prior knowledge in order to answer the test item. 

In addition, the test also includes self-report items that assess student knowl- 
edge that is drawn from "reading" the illustrations and from being aware of 
the text organization of specific reading passages. It also includes items that 
assess students' interest in and feelings about various reading selections. 
Initial reactions of parents and teachers to the test have been positive, 
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Assessment: 

How do we measure 
understanding? 



Section 3: 

Transparency 
Masters 



List of Transparency Masters for Reading Assessment: 
How do we measure understanding? 



The transparency masters included in Ms section are listed below. An identification number appears in 
the lower right hand comer of each master to facilitate assembly of woikshop packets and quick refer- 
ence during presentations. 

In Older to make the workshop as flexible as possible, we have included a selection of transparency 
masters from which you may choose. Some masters contain graphics, but alternative versions without 
graphics are included so you can use ^phics of your own choosing. 



Transparency ID # Transparency Title 

Tl Reading Assessment: How do we measure understanding? 

T2 Chinese Text 

T3 Arabic Text 

T4 Minor-Image Text 

T5 "Computerese" Text 

T6 Interaction of Reader, Text, and Context 

T7 Reading Assessment Questions 

T8 Becoming a Nation of Readers Quote 

T9 Means & Knapp Quote #1 

T 1 0 Means & Knapp Quote #2 

Tl 1 Integrating Reading Comprehension Assessment & Instruction: 

Sample Strategies 

T12 Reading Program Assessment- Step One 

Tl 3 Reading Program Assessment- Step Two 
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Transparency ID # Transparency Title 



T14 


Before Reading . . . 


T15 


. . . during reading . . . 


T16 


. . . after reading. 


T17 


Making Reading Meaningful 


T18 


ReQuest 


T19 


QAR 


T20 


Recipnxial Teaching 


T21 


KWL 


T22 


K-W-L [Chan] 


T23 


Semantic Mapping 


T24 


Think along/Think aloud 


T25 


Reading Interview 


T26 


From assessing reading skills m isolation to . 


T27 


"Teaching is asking not telling" 


T28 


"As a tool for aswssment, ..." 


T29 


Student Strategies To Use In A Think Aloud 
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Reading Assessment: 
How do we measure 
understanding ? 
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The existing BBS that PRC is proposing to modify is based on the Unix System V 
operating system. Unix has a long and successful history of providing multi-user 
environments on numy diverse hardware platforms, including support for remote dial-in 
access. It is this successful histoiy of multi-user suppon that makes a Unix-based system a 
namral selection for the BBS configuration. 

The specific Unix operating system recommended for the BBS is Santa Cruz 
Operations (SCO) Unix System V/386. The unlimited user version of SCO Unix V/386 is a 
fully licensed and conforming implementation of AT&T's Unix System V. In addition to 
conforming to System V deifications. SCO Unix System V/386 also conforms to Federal 
Information Processing Standards (FIPS). SCO Unix V/386 is also designed to provide strict 
security features and conforms to Department of Defense National Computer Security Center 
(NCSC) Trusted Computer Systems Evaluation Criteria (TCSEC) at the C2 level. SCO Unix 
provides suppon for MS-DOS applications through SCO VP^. SCO VP/ix allows IX>S 
applications to run concurrently with multiple Unix processes. SCO's File System Switch 
(FSS) also allows DOS partitions to coexist with Unix partitions on the same hard drive, and 
allows access to both file systems. 

The computer hardware platform to be procured for the Unix-based configuration is an 
IBM-compatible 386. For the initial BBS, a 386 is well configured to provide sufficient 
performance for four remote users. The 386 will include a 300 nxgabyte hard disk drive to 
provide storage for the software, user-accessible database, and audit trails and log files for 
tracking user activities. Additionally, the 386 will include 24 megabytes of RAM memory 
which affords each remote user sufficient RAM for execution of their particular application. 

For the BBS application, Unix provides the capability for remote usen to dial-in as 
terminal (e.g., VT-100) sessions. Either microcomputers or "dumb" terminals (without a 
processor) may be used to access this configuration. SCX) Unix V/386 also suppons 
electronic file transfers via standard protocols such as XModem, YModem, Kermii, etc. Unix 
also provides on-line help features to login users. 

SCX) Unix provides a menu-driven interface called "sysadmsh" which supports system 
administration and security requirements. Functions supponed by sysadmsh include: 



J 
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within the 



Influencing Factors 




within the 



Text ' 




converge to 
construct 



Meaning 



within the 



Context 
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Reading Assessment 
Questions 



1 . How can we best document that growth and im- 
provement in reading has occurred? 



2. How can we best evaluate the quality and nature of 
growth in reading ability? 



3. How can we best commuiiicate this information to: 

• students, so they can reflect upon their own 
literacy development? 



teachers, so they can plan further instruction 
building on what the child already knows? 



parents, so they can be well informed about 
their child's progress? 

other, external decision-makers, so they can 
make good planning decisions? 
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"Standardized tests of reading 
comprehension manifestly do not 
measure everything required to 
understand and appreciate a 



novel, learn from a science 



textbook, or find items in a 



catalogue." 



[From Becoming a Nation of Readers, 1985, p. 94] 
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"The difficulty in measuring 
meaningful higher-order tasks 
with economical paper-and-pencil 
measures has led to an emphasis 
on measuring discrete 
components of complex tasks 
rather than the tasks themselves." 



[From Means and Knapp, 1991 , p. 4] 



C&l Specialty Option I PRC. Inc. 1 2601 Forme Circle East. Suite 300A I Indianapolis. IN 46241 1 (800) 456-2380 T-9 



Assessment measures focused on 
mastery of basic skills tend to: 

• "underestimate what disad- 
vantaged students are 
capable of doing; 

• postpone more challenging 
and interesting work for too 
long ~ in some cases, 
forever; and 

• deprive students of a mean- 
ingful or motivating context 
for learning or for using the 
skills that are taught." 



[From Means and Knapp, 1991 , p. 3] 
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Integrating Reading Comprehension Assessment & Instruction 

Sample Strategies 



Before Reading 

Activating Prior Knowledge 
Reading Interview 
Word Associations 
Passage-Independent Questions 
Passage-Independent Vocabulary 

Predicting 
YeslNolMaybe Statements 
Brainstorming 

Setting Purpose 
Memory Retrieval Strategies 
KWL (What we know & what we 

want to find out steps) 
SQ3R (survey & question steps) 



During Reading 

Out Loud 
Think-Aloud Protocols 
Self-Corrections 
Miscue Analysis 

Cloze Tasks 

SQ3R (directed reading step) 

Coding Text 
Circling Key Words 
Underlining Key Concepts 
Marginalia 

NcHlctaking 
Cornell Method 
Herringbone Technique 

ReQuest/Reciprocal Teaching 



After Reading 



Free Recall 
Retelling 
Summarization 
SQ3R {recite & review steps) 
Story Grammarl Expository Text Patterns 
Multimedia Responses 

Probe^Prompts 
Open-Ended Questions 
Story FrameslOutline Frames 
Semantic Mapsf Webs/Weaves 

STaR (Story Telling and Retelling) 
KWL (what we learned & still need to know step) 
Question-Answer Relationships (QAR) 
Question-Answer-Detail (QAD) Chart 
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CHAPTER 1 READING PROGRAM 
ASSESSMENT-- Two Steps 



To improve your reading program, it is helpful to review your present program in light of current 
research. In order to complete such a review, guidelines for a two-step process are provided in this 
handout. It is important to complete the first step either independen Jy or in small discussion groups 
before proceeding to the second step. 

STEP ONE: What Should We Be Doing? 

In the left-hand column of the chart below, statements derived from research are listed. These state- 
ments represent specific findings from a variety of research studies which explored the process of 
reading, reading instruction, and reading habits. As with all research, these findings suggest implica- 
tions for classroom instruction and student evaluation. Read each statement. Then think about or 
discuss possible implications of the statement In other words, think about or discuss what the 
statement suggests for reading instruction and evaluation. 

Reading Process 

What does the research say? what does this suggest . . . 

for instruction? for student evaluation? 

1. Setting a purpose for reading 

aids comprehension. 



2. Prior knowledge is a critical 
determining factor in 
reading comprehension. 



3. Good readers use a variety of 
strategies to attain meaning and 
adjust their strategies to the 
demands of the text. 
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CHAPTER 1 READING PROGRAM 
ASSESSMENT - Two Steps 



STEP TWO: What Are Wc Doing? 

In Step one, you reflected ui^n cunent research findings in reading and their implications for in- 
struction and evaluation. In step two, you will describe the status of your Chapter 1 reading project 
by scoring each statement on the scale of "1" (not at all like our program) to "5" (very much like our 
program.) If you have no knowledge of an item, put an X through the item number at the left. After 
completing the rating, circle the number in front of the five items you feel should receive special 
attention in improving the program for Chapter 1 students. 
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1. Carefully stated goals/desired outcomes have 
been developed for the Chapter 1 reading 


1 


2 


3 


4 


5 


CURRICULUM 












2. Chapter 1 uses the district/classroom curriculum 
as a £uide to nrovidin^ neadin? in«tnirrinn 


1 


2 


3 


4 


5 


3. Chapter 1 and regular classroom staff have worked 
together to design a reading curriculum thai is 
based on current research. 


1 


2 


3 


4 


5 


4. The main goal of the reading curriculum is to 
teach reading comprehension and to teach word 
recognition skills within that context. 


1 


2 


3 


4 


5 


5. A variety of reading materials and real-life purposes 
for reading are included in the reading curriculum. 


1 


2 


3 


4 


5 


6. Interpretive and critical reading strategies are a 
regular part of the curriculum in Chapter 1. 


1 


2 


3 


4 


5 
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Before Reading . . . . 
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• • . • during reading • • • . 



5 
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.... after reading. 
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Making Reading 
Meaningful 



Three-step student response — 



What did you notice about the story? 



How did the story make j feel? 



What does this story remind you of in your 
own life? 



[From: Kelly, RR. (March 1990). Guiding young students' response to literature. 
The Reading Teacher, 41 (7), 464-470.] 
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ReQuest 



Read 



Student 

asks questions 

of teacher 





teacher answers 
student's questions 



Keep reading 



teacher 

asks questions 

of student 





student answers 
teacher's questions 



Repeat 
with next 
text block 
until 

Student can make 
own predictions 
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f — 1 




f — 1 




f? " ' ^ 




^ ^ 


Right 
There 




Think 
& 

Search 




Author 
& 

Me 




On 
My 
Own 


L i 




L i 




I i 




s i 
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recalling what they 




determining what they 



Want 



to know 



identifying what they 




as they read 
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K-W-L 



What I already 
KNOW 


What I WANT 
to Know 


What I LEARNED 
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Think along 





Think aloud 



Teacher models 
the process 



Students leam to frame 
higher-order questions 



Students gain awareness 
text structures 



/ \ 

Teachers gain awareness of 
students' reading strategies 
V . 
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Reading p \ 



Interview 



How did you 
learn to read? 




Do you think 
you are a 
good reader? 
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From: 



Assessing reading skills 
in isolation to . . . 



Assessing reading 
strategies in context . . . 




o 
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Good teachers know that 



"Teaching is 
asking 




not telling" 



— Jean Marzollo 



[From: MarzoUoJ. 0987). The new hndergarten: Full day, cMld^eniered.accukmic. New York: Harper 
and Row Publishers.] 
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"As a tool for assessment, 
portfolios focus on a student's 
productive work ~ what the 
student can do, rather than what 
he[she] cannot do." 



[From Mumme, 1990] 

C&l Specialty Option I PRC, Inc. 1 2601 Fortune Circle East. Suite 300A I Indianapolis, IN 46241 1 (800} 456-2380 T-28 



Student Strategies To Use In A 
Think Aloud 



1 . Guess the meaning of words 

2. Use information in the title or in headings to make guesses 

3. Use information in the pictures to help you understand 

4. Use information you ahieady know to guess what will happen next 

5. Make predictions 

6. Revise your predictions 

7. Think about the sequence of events 

8. Pretend you are the character 

9. Talk about your feelings and emotions 

10. Make mental pictures of what's happening in the story 

1 1 . Summarize what's happening 

1 2. Reread sections to clarify their meaning 

1 3. Stay open to new interpretations 
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Reading 
Assessment: 



How do we measure 
understanding? 




Chapter 
Curriculum & 

Instruction 
^Resource Center 
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List of Handout Masters for Reading Assessment: 
How do we measure understanding? 



The handout masters included in this section are Usted below. An identification number iqjpears in 
the lower right hand comer of the first page of each handout to facilitate assembly of workshop 
packets and quick reference during presentations. If the content of the handout has limited grade 
level applicability, the appropriate level is listed in italics under the identification niunber on the 
master. 

The mastm include sample student and program usessment instruments, structured overviews of 
current views of reading com|niehension theory/traditional assessment methods and altonative 
assessment, and a range of strategies that can be used to integrate instruction and assessment The 
handouts suppon assessments that: 

• are teacher constructed/conducted 

• are based on reading tasks with actual classroom materials 

• are fully integrated with instruction 

• identify student strengths as well as instructional needs 

• incorporate and develop student self-evaluation 

• measure process 

• are ongoing and dynamic 

• stress the use of multiple tools, environments, strategies, and texts 



Handoi^t IP # Handout Title 

HI A Set of Contrasts Between New Views of Reading and 

Current Practices in Assessing Reading 

H2 An Overview of Alternative Reading Assessment 

H3 An Overview of Portfolio Assessment 

H4 Integrating Reading Comprehension Assessment & Instruction: 

Sample Strategies 

H5 Reading Interview 

H6 Assessing Prior Knowledge 

H7 Integrating Instruction and Assessment with 

Memory Retrieval Strategies 
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Reading Assesmtera" List cf Handout Masters Page 2 

nm<^WX JD # Handout Title 

H8 Integrating Instruction and Assessment with KWL 

H9 Integrating Instruction and Assessment with SQ3R 

HIO Integrating Instruction and Assessment with Think Alouds 

HI 1 Integrating Instruction and Assessment with the 

Reading Miscue Inventory 

H12 Integrating Instruction and Assessment with the Qoze Procedure 

Integrating Instruction and Assessment with Text Coding Strategies 

HI 4 Integrating Instruction and Assessment with the 

Herringbone Technique for Note-Taking 

H 1 5 Integrating Instruction and Assessment with 

the Cornell Note-Taking System 

H 1 6 Integrating Instruction and Assessment with Reciprocal Teaching 

H 1 7 Integrating Instruction and Assessment with the ReQuest Pnjcedure 

H 1 8 Integrating Instruction and Assessment with Story Retelling 

Integrating Insd action and Assessment with Expository Text Structures 

H20 Integrating Instruction and Assessment with Multimedia 

Responses to Literature 

H2 1 Integrating Instruction and Assessment with Teacher (and Student) Questions 

H22 Integrating Instruction and Assessment with Semantic Maps 

and Story Schema 

H23 Integrating Instruction and Assessment with Question-Answer 

Relationships 

H24 Integrating Instruction and Assessment with Question-Answer 

Detail Charts 

H25 Chapter 1 Reading Program Assessment- Two Steps 

H26 Workshop Evaluation Form 
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A Set of Contrasts Between New Views of Reading 
and Current Practices in Assessing Reading 



What new views of tfae reading 
process tell us 



What we traditionaliy do to 
assess reading comprehension 



nior knowledge isan impoitam 
d^emiinam of i?ading compn^henskm . . . 

A (^ptete story or text has structural 
aiK! R^pical integrity . . . 



Inference is an essmtial i»nof the 
]Hocess comprehending units as small 
as^tences.«« 

The diversity in prior knowledge acrc^ 
individuals as wdl as the varied rausal 
fdations in human experiences invite 
many possitsle infer^K^ to fit a text or 
questim . . * 

The ability to vary reading strat^des to 
fit the text fflHi the simaticm is one 
haUmaik of an expert feactea* . . . 

The ability to synthesize inf(mnati(Mi 
firom varKnis parts of the text and diffeient 
textsiscme halhnaric of an expen reader . . . 

The ability to ask good questions of text, 
as wtll as to answer them, is cme hallmark 
of an expen reader . . . 

All ^pects of a reader^s expaience, in- 
cluding habits that arise from school 
home, influence reading ccHnprehenskm . . 

Reading involves the orchestration of 
many skills that complement one another 
in a variety of ways . * * 

Skilled readers are fluent; their wcaid iden- 
tilication is sufficiently autonuitic to allow 
most cc^tive r^jurces to be used for 
Gomprehensioii . . . 

Learning from text involves the restiuc* 
turing, application, and flexible use of 
knowle^sc in new situations * . . 



ya vi^ msdc any letoicAshqi betwera prior 
kncwledge and le^ing comprahrasicxi by us* 
ing kits of sbcsn parages cm lots ctf tqncs. 

ya we use short texts tlot %Idom approx- 
\m?' ^ the stn^tixral and tt^ical integrity of 
an mithratic text 

yet we rely on literal comprehei^ion test 
items. 



ya we use multiple choice items with only 
erne ccmtct answo't ev» whoi many of the 
re^pcHises might, undo* certain cxmditions, 
be plaisible. 



y^ we selctom assess how and when students 

the ^t^^ th^ use during mmnal 
reading, studying, or when the going gets tough. 

yet we rarely go bey<HKl finding the main 
idea of a paragraph or pass^e. 



yet we selctom a^ stud^ts to create (»* select 
questicxis about a selection they may have 
just read. 

yet we rarely view infmnaticm on reading 
habits and attitudes as being important 
information about performance. 

y^ we use tests that fragment reading into 
isolated skills and t&pon performance on each. 



yet we rarely insider fluency as an index of 
sk'Ued re^rs. 



yet we often ask readers to re^nd to the 
text's declarative knowledge rather than to 
^ly it to near and far transfer tasks. 



[Source: Pearson, P.Dn & Valencia, S. (April 1987). Reading asscssmcni: 
Time for a diange. The Reading Teach^, ^ (8X 73 1 .J 
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An Overview of Alternative Reading Assessment 



Standardized testing provides us wi^ a snapshot of the achievennents of a student at one point in time. 
It is a method of measuring the student's knowledge and ability regarding specific information on a 
given day. in a group setting, in comparison with other children. Such results need to be used cau- 
tiously. While standardized testing has its place, it needs to be balanced with other forms of assessment 
to give a more complete picture of a student^s capabilities. 

The methods described in this overview reflect assesaneni practices congruent with the most current 
research-supported deflnitions of reading comprehension which emphasize the importance of prior 
knowledge; the interaction of reader, text, and context; and the use of metacognitivc strategics. To- 
gether, these methods can be used as part of a program for conducting assessi *ms that: 

• are teacher constructed/conducted 

• axe based on reading tasks with actual classroom materials 

• are fully integrated with instruction 

• identify student strengths as well as instructional needs 

• incorporate and develop student self-evaluation 

• measure process 

• are ongoing and dynamic 

• stress the use of multiple tools, environments, strategies, and texts 

The methods described in this overview can be used at a wide range of instructional levels, including 
early childhood, elementary, secondary, and adult basic education. 

Alternative assessment is usually of two basic varieties: observation and performance-based. Observa- 
tion assessment is teacher-oriented and depicts factual recording of observed activity. Performance- 
based assessn^nt is designed by teachers and students and allows students to denK)nstrate their abilities 
through the development of student activities and products. An overview of the advantages and disad- 
vant2 alternative assessment methods which can be used in reading as well as in other content 
areas provided in a chart on the next page. Following the chart, there are additional pages of descrip- 
tions including information on each of the specific methods of assessment listed in the chart under the 
categories of observation assessment and performance-based assessment. 

i I H2 
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An Overview of Alternative Reading Assessment 



Summary 


Advantages 


Disadvantages 


OBSERVATION 
ASSESSMENT 

• Anecdotal recorcts 

• Checklists 

• Rating Scales 

• Participation Chans 


• Canbe^ificallyi^latedto 
cuiTOit instructional objectives. 

• Helps ddect problems as they arise, 
rather than waiting fof the next 
testing cycle. 

• Assesses chikl in ccntextraUmthan as 
an isolaied individual. 

" Can be unobtnisive. and the child does 
iKH need to react in a specified fashion. 

• Can provide infomation not available 
in any (Khar way. 

• Helps the teacher chedc for fgjplication 
BJm geTOWizauon 01 Knowledge ana 
skiU& 

» Helps dc^t behavior pattmis and 
changes in pauems. 


• Can be very lime WMuaiming to collect 
and analyze data. 

• Can be difficult to coordinate classroom 
management to make <rt»crvaticms. 

« Teachers n^ training and i»iactice in 
order to know what to look for, how to 
record it, and how lo ise the infcmnation. 

• Data may be useless unlc^ it is selec- 
tively and car&fuUy sun- 
manzed 

« Te^j)^ may feel that they already 
otwTve ^ents aiKl that mm system- 
atic obscrv^on is unnecessary* 

• Obsovaitons might be too subjective 
unless carefully done. 


PERFORMANCE- 
BASED 
ASSESSMENT 

• Portfolios 

• Interviews 

• Questioning 

• Writing 

• Self-assessments 

• Peer group (j^oup 
evaluations) 

• Student creations 
(i.e. audiotapes, 
videotapes, com- 
puter demonstration, 
debates, art work) 


• May be pan of the child's regular 
daily activities. 

» May be specifically related to 
cunem instructional objectives. 

^ Can be used to a^ess highly complex 
behaviors or tasks which q^proximate 
the conditions and lesomt^ children 
mmnally encounter in the classroom or 
in real-life sMtin^. 

• Can be ufK)btnisive* 

• Provides the teacher with a valuable 
resource for assessing progr^ and 
sharing individualized information 
with parents of csher teachm, 

• Allows for the triangulation of data 
widi that from oth^ sources- can 
provide multiple exam{^ (tf support- 
ing information, thus providing infor- 
mation regarding the richness and depth 
of a student's learning. 

• Can measure process as well as product 


• Can be time consuming, parttcularly if 
the dass is large. 

• Amount of data may be overwhelming 
unless gathered selectively and care- 
fully summarized. 

• Teachers mayhap difficulty schedul- 
ing free time to analyze work samples. 

« Tethers need tniifung and practice in 
order to know what to took for. how to 
^unmarize infcmnaticxi^ and how to 
use it 

• Needs more cocmiinatiGffi of evaluation 
critoia or staiulards when applied to 
the ^ .miponents of an instructional area 
to ' tl:e cflfort worthwhile, 

• Early woik may be inappropriately 
judged if ba^line and tracking proce- 
dures are not understood or not used 
COTPectly. 

• Storage demands may be burdensome. 
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Overview <tf Alternative Rea ding Assessmau 

OBSERVATION ASSESSMENT METHODS 



Pages 



Anecdotal Records arc factual descriptions of observed activities. 

• Anecdotal reports are best suited for reccwding unanticipated, spontaneous events or incidents. 

• Descriptions must state clearly what happened in observable behaviors, when it happened, and 
undo* what circumstances. 

• Description must be limited to one specific event 

• Evaluation needs to be supported with other verifying information. 

Checklists consist of a series of statements about behaviors that are expected to occur. 
They contain space to record behavior if it has been observed. An ongoing 
checklist also should include a space for the date of the observed behavior. 

• Checklists arc used when behaviors can be anticipated and when there is no need to 
record the frequency and/or quality of the performance. 

• Checklist items must be based on instructional objectives, and items must be clearly 
defined. 



Rating Scales are lists of anticipated behaviors with information about the 
frequency and quality of performance. 

• Rating scales must describe each degree, quality, or frequency of behavior as specifically 
as possible to avoid subjectivity, 

• Components of a specific behavior need to be rated in separate scales or dimensions. 

Participation Charts list the names of children and piDvide space to record their 
respective participation in a specific activity. 

• Participation charts provide infomiation on student participation in activities, e.g.. number of 
books checked out from the library, number of books read, number of minutes spent on 
reading each day. 

• Assessment through charts infers a range of participation over time for an individual student 

• Behaviors defining participation in a specific activity must be clearly determined to avoid 
subjective judgements. 

• Several observations of episodes must occur to get representative samples of behavior. 

• Data must be summarized to be meaningful. 
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Overview of Alternative Reading Assessmem 

PERFORMANCE-B ASED ASSESSMENT METHODS 



Page 4 



Portfolios are collections of student-produced artifacts that serve as evidence of profi- 
ciency. Items chosen for inclusion give an indication of what is valued. Dates 
are recorded on all papers as well as indications of whether the woik is the result 
of individual or group activity. 

• Enlarge the view of what kinds of learning are occurring. 

• Provide evidence of perfwroancc beyond factual knowledge. 

• Show student level of control of new processes. 

• Allow a developmental look at progress. 

• Provide the history of a piece of work and a permanent, long-term record of student progress 
reflecting the life-long nature of learning. 

• Provide opportunities for improved student self-esteem since portfolios feature accomplishments 
rather than deficiencies. 

• Facilitate the recognition and valuation of different learning styles. 

• Provide an active self-assessment role for students by having them share joint responsibility with 
the teacher for assessing progress. 

Peer Report/Group Evaluation consists of student analysis and assessment of peer 
proficiency using either established or self-generated criteria. 

• Collaborative and cooperative classroom organization builds student knowledge of the talents 
of their peers and provides sound theory and methodological support for peer evaluation. 

• An activity must be very carefully structured if students are to receive valid feedback from 
their peers. 



Investigations involve students in assessment that is natural and non-invasive. During 
the investigation, assessment activities or questions are presented to the stu- 
dents much in the way they occur in regular classroom activities. 

• Investigations may be related to other subject areas, thereby integrating curriculum, or they 
may be solely in one area. 

• Although the most typical form of investigation is through a collection of student writing, 
diagrams, graphs, tables, or charts, there are also opportunities for observation or videotaping 
of student performance. 
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Overview cf Mtenative ReoiHng Assessment 

PERFORMANCE-BASED ASSESSMENT METHODS (com.) 



Pages 



Investigations (cont.) 

• lo reviewing investigations, judgments can be made about students' ability in defining a 
problem and identifying relevant prior knowlege; making a plan; creating, modifying, and 
interpreting strategies; collecting needed infonnation; organizing the infonnation and looking 
for patterns; discussing, reviewing, revising, and explaining results; persisting; looking for more 
infonnation if needed; and producing a quality pnxiuct or report 

Interviews consist of stractured or unstructured dialogue with a student in which the 
student reports his or her reaction or response to a question or questions. 
Questioning for the purpose of assessment can be brief and informal as in many 
typical classroom mteractions between teacher and students, or it can occur over 
a more extended period of time where an interviewer really probes to get at what's 
going on in a student's mind. 

• Interviews can be an opportunity to determine the student's depth of understanding rather than 
whether the smdcnt can provide the correct answer. 

• Cues, prompts, or probe questions can be used to produce more assessment information. 

• Interviews are not constrained by smdent's difficulties with written language. 

• Wait time for the student to formulate an answer must be considered. 

Writing opportimities include journal entries, reports of investigations, explanations 
of processes, and responses to open-ended questions. 

• Writing enhances learning when concepts have to be formulated, organized, internalized, and 
evaluated. 

• Feedback and self-assessment are vital to the student's growth in writing. 

SelfAss€Ssment/Se(f Report are methods that empower studexits. Self assessments and 
reports provide a student's analysis of his or her perceived or desired level of profi- 
ciency. Those who are able to review their own performance, explain the reasons 
for choosing the processes they used, and identify the next step have a head start 
on lifelong learning. 

• Students can show surprising insight into what they know and what they need to learn. 

• This strategy helps students develop the skills of self-evaluation and self-involvement 
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PERFDRMANCE»BASED ASSESSMENT METHODS (cont.) 
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SeffAssessment/Seff Report (cont.) 

• Self-asscssmcm can be rccwded through questionnaires or journals where "I learned" statements 
are answered by the student 



Questioning may involve searches for specific answers or may be open-ended. An open- 
ended question is one in which the student is given a situation and is asked to com- 
municate a response. Questions may be more or less "open" depending on how 
many restrictions or directions are included. Questions and responses may ue oral, 
written, or demonstrated by actions. 

• Questioning contributes to a cliroate of thoughtful reflectiveness. 

• Open-ended questions help match assessment to good classroom questioning strategies. 

• Through responses to qjen-cnded questions, it is possible to discover whether students can 
recognize essential points, organize and interpret information, report results, use appropriate 
language, write for a given audience, make generalizations, understand basic concepts, clarify 
and express their own thinking. 



Other Student Products may include writing in the form of journals or open-ended 
questions, audiotapes, videotapes, computer demonstrations, debates, dramatic 
performances, reports, etc. 

• Through products, students can demonstrate the following: understanding, originality, ability to 
present reports in an effective and attractive manner, growth in social/academic skills and atti- 
tudes, and success in meeting criteria. 

• Products may be used to engage students who are not enthusiastic about school, bring education 
to life, and demonstrate to the community what students arc achieving. 

• Student products can provide a bridge between classroom and real worid activities. 

• Student performance observed through products allows for the integration of different 
subject areas, gives students flexdme to do thoughtful woric, permits students to work with 
others, and encourages creativity. 
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Parent Interviews consist of structured discussions with parents (or other primary care 
takers) about specific observations of children's behavior or progress. 

Appropriate Use s: 

• When confirmation of a child's behavior or performance is desired. 

• When further information is need»l to understand a child's behavior in class. 

• When problems exist and a parent's input is needed to plan intervention. 

Cautions: 

• Information gained is strongly related to the interviewer's skills. 

• Questions should be clearly defined in advance. 

• Use of the information gained should be determined in advance. 

• Many parents have had negative experiences with school and may be reluctant to 
participate. 

• TTic parent point of view is often strongly biased positively or negatively. 



ADDITIONAL SOURCES OF DATA FOR ASSESSMENT 



Existing Records can be reviewed for infonnation that has akeady been compiled by 
others. This may include any type of data which has been systematically collected 
or is a by-product of other activities. For example, school emei^gency forms, stu- 
dent records, local census forms, or parent meeting sign-up sheets may already 
contain information on children and families that can be useful in planning or 
evaluating programs. 

Appropriate Uses: 



• When there is a wide variety of information readily available. 

• When objective, accurate information is needed to support more subjective interpretations. 

• When cost and time are factors in obtaining the information. 

• When staff time is limited. 

Cautions: 

• Records may contain incomplete or missing data. 

• It may take some time and effort to extract the desired information from existing records. 

• There may be legal requirements concerning confidentiality. 

• Data may not be available in the form needed. 
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An Overview of Portfolio Assessment 



When planning reading assessments, there are some key questions teachers need to ask themselves 
Why am I testing this child? How will I use the information? In what fMm can this infonnation best be 
communicated to the target audience(s)? Traditional standardized norm-referenced tests are insufficient 
to validly and reliably represent the diversity of skills and abilities mastered by students over a period of 
time. There have been a number of recent suggestions about how to better "capture" the diversity, 
including the following: 

• broaden the scope of the procedures and materials used to assess reading; 

• use more observational data; 

• use more informal, performance-based assessment; and 

• relate the assessment more closely to instructional goals. 

According to Pikulski (1989), the "portfolio philosophy of assessment" encourages the collection of 
diverse samples of literacy events, gathered in an on-going fashion in which readers interact naturally 
with text. Portfolios can help communic8t»! to the students themselves and to others the message that 
"leaming is never completed, instead it is always evolving, growing, and changing" (Valencia, 1990), 

Tj e Portfolio Approach to Reading As sessment 

The poitfolio approach has emerged as the current leader in alternative assessment methods as schools 
have moved toward mor. Naturalistic forms of assessment. Used initially in the fine arts, portfolios have 
now Income assessment tools for all content areas, including reading. 

Portfolios offer an alicmative means of Uocumennng, evaluating, and communicating a student's growth 
in literacy. A portfclin approach has come to be defined as the collection of a variety of different types 
of evidence regarding student growth and progress in reading and literacy tasks over time. Portfolios 
provide a form of naturalistic evaluation because they are directly linked to instruction and involve real 
literacy activities that occur over a period of time. The variety of student products found in portfolios 
can include wntings fh)m journals, open-ended questions, videotapes, audiotapes, computer demonstra- 
tions, charts, graphs, diagrams, dramatic performances, bulletin boards, photographs, debates, group 
reports, student conference simulations, artwork, construction models, - a list thai is constrained only by 
the imagination of the student and the teacher. 

Portfolios have been defined in numerous ways, including the following: 

"[A portfolio is] a collection of evidence used by the teacher and student to monitor the growth of a 
student's knowledge of content, use of strategies, and attitudes toward the accomplishment of goals in an 
organized and systematic way." (Roenger & Szymczuk, 1990) 

"A portfolio, quite simply, is a collection of student work. ... It can be used to document progress 
rather than one's finest accomplishments. As a tool for assessment, portfolios focus on a student's 
productive work ~ what the student can do, rather than what he cannot do." (Mumme, 1990) 
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Portfolio Assessment 



"A pcrtfolio is a purposeful, integrated collection of student woric showing student effoit, progress, or 
achievement in one or more areas. The collection is guided by perfOTmance standazds and includes 
evidence of students' self-xeflection and paiticipation in setting the focus, selecting contents, and judging 
merit. A portfolio communicates what is learned and why it is important" (Paulson & Paulson, 1991) 

Portfolios can be used to help meet several important education goals. These include "helping integrate 
instruction and assessment; providing soidents. teachers, parents, administrators, and other decision- 
makers with essential inf(»mation about child progress and overall classroom activities; making it 
possible for children to participate in assessing their own work; keeping track of children's individual 
progress; and forming the basis for evaluating the quality of a child's overall performance" (Meisels & 
Steel. 1991). 

Challenges and Benefits 

Management issues are chief among the challenges facing educators interested in adopting the use of 
reading portfolios. The most common questions teachers and administrators have indude the following 
(Mummc, 1990; Valencia, 1990): 

• How and where are portfolios stored? 

• Do they get passed on from grade to grade? How? 

• Will portfolios take too much time? too much stomge space? 

• Who "owns" the portfolio? (the student? the school?) 

• Are portfolios too product oriented? 

• Is the information reliable? 

• Is the information consistent or inconsistent? 

• Arc the quality and quantity of materials included in portfolios unequal across different 
classrooms and teachen? 

• Arc the products included varied enough to indicate learning across many 
situations, including before, during, and after reading instraction? 

• Are materials that go in the portfolios, such as videotapes, audiotapes, or 
photographs, too expensive? 

A chief benefit is the way that portfolios serve to encourage a number of positive attitudes and behaviors 
among students, teachers, and administrators. Johnson (1991) pointed out the following advantages: 

Portfolios encourage students : 

• to take more resjxinsibility for their v ork 

• to see themselves as apprentices 

• to value daily work as a meaningful part of learning 

• to see mistakes as opportunities for learning 

• to see revision as an opportunity to succeed 

• to spend more time thinking about tiieir teacher's response 

• to spend more time conferring with classmates 

• to spend more time reconsidering and improving their work 

• to be more creative, to feel more confident, to be more productive 

• to take pride in their work, to perform, or display what they know 
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Portfolio Assessment 



Challenges and Benefits (cont.) 



Portfolios encourage i£a£lis£&: 

• to see themselves as professionals, as mentors, and facilitators 

• to rediscover the powo* they have to challenge students 

• to give assignments that help students to take on increasingly difficult tasks 

• to allow time for student collaboration and reflecdon 

• to help students learn how to revise and edit their work 

• to explore a variety of ways to help students Icam how to solve problems 

• to assess student progress on a range of tasks and over time 

• to evaluate the effectiveness of assignments in the light of student responses 

• to see evaluation as part of the learning process, their's and the smdents' 

• to share, display, and honor good work 

Portfolios encourage i£a£ll££& ami administrators: 

• to work together, to re-examine instructional objectives 

• to reconsider and. if need be, to redesign curricula 

• to prepare students for district and statewide tests 

• to explore alternative forms of assessment 

• to promote a schoolwide reading and writing program 

• to spend more time conferring with parents and students 

• to build in time for professional growth, classroom research, and reflection 

• to honor a variety of good work, to celebrate students' achievements 

• to find satisfaction in their own growth and good work 



Content Selection and Evaluation Criteria 



The goal when using reading portfolios is to assess a student as he or she is involved in natural literacy 
activities. It is then that the student's skills can be seen in an integrated, real-woxld context. In assessing 
portfolios, two factors arc critical: (1) the selection of products to be included in the portfolio and (2) 
the criteria used for evaluating the portfolio contents. 

Selection of products needs to be a process in which both the student and the teacher participate. The 
teacher needs to ensure that there are selections that can be used to answer the following questions: 

• Is there progress from the earliest dated works to the most recently dated works? 

• Is there evidence of sufficient variety to challenge all students and to allow each 
student an opportunity for success? 

• Is there evidence of teacher/peer response to the student's drafts, and is there 
opportunity for the student to revise? 
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Students can help select the work samples that diey feel represent their "best" work. What is one's best 
work? An exaniple of literacy work that the student feels represents hisi/her best achievement is one 
definition. A teacher may help die student select the piece of work. It may come from any class, and it 
may or may not address an academic subject. Students should have a chance to review the evaluation 
criteria before selecting their best pieces of work (Vermont Writing Assessment, 1990). 

The key goals of reading instruction need to be defined and explicitly stated in order to establish criteria 
for both assessing student growth and selecting items to include in a student's portfolio. The portfolio 
should be used to expand upon information that is already available from other sources. For example, 
story maps can be used to assess a student's knowledge of plot structure in general as well as compre- 
hension level with a specific reading. 

According to Valencia (1990), all portfolios need two sections: 

1 ) a section for the actual evidence and 

2) a summary sheet. 

The evidence forms the bulk of the portfolio since it includes all of the various representations of student 
work samples, reflective self-evaluations written by the student, teacher notes or anecdotal records, 
interviews, etc. 

Different schools and teachers use various combinations of items in their portfolios. Some examples of 
the kinds of evidence of student learning most frequently included in portfolios are listed below. 

• instructional tests 

• results of standardized tests 

• lists of books read by the student 

• upes or videotapes of oral reading (elementary grades) 

• writing samples 

• selected entries from reader's response journals 

• books "published" by the smdent 

• photographs of bulky student creations 

• student self-assessments of his or her growth in reading abilities 

• reading attitud^nterest interviews or inventories 

• teacher anecdotal/running records, interview transcripts, and observation reports 
evidence of the u% of reading strategies 

• student exhibits and work samples 

• student drawings^llustrations inspired by stories or books 

A summary sheet serves as an organizing framework for synthesizing the bulk of information for greater 
ease of use by parents, teachers, administrators and other staff members. 
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Content Selection and Evaluation Criteria (cont) 
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in both selecting content and developing report fonnats, educators need to answer the following 
questions for their respective situations: 

• How do you summarize a portfolio to validly and reliably ccMnrounicate what a 
student has learned over long periods of time, such as a year or more? 

• What information is most important to communicate to a student regarding his or her 
growth in literacy in order to motivate continued reading? 

• What information do parents n:K>st want to know about what their son or daughter 
has learned over the year? 

• What information does next year's teacher nwst want to know about what a particular 
student has learned in a year? 

• What information does an external decision-maker most want to know about what a 
student has achieved during a school year? 

There are a number of reports and guidelines available describing how various teachers, administrators, 
and school systems have addressed these and other questions; many of these materials include descrip- 
tions of the evaluation procedures and reporting forms that have been developed (e.g.. Roettger & 
Szymczuk, 1990; Vermont Writing Project, 1990). The Test Center at the Northwest Regional Educa- 
tional Laboratory has an extensive collection of documents on alternative and portfolio assessment as 
wdl as annotated bibliographies on both topics. Most of the documents arc samples of informal assess- 
ment procedures developed for classroom use. Documents can be checked out and copies of the bibliog- 
raphies can be obtained by calling the Test Center staff at (503) 275-9500 or writing to them at 101 S.W. 
Main Street, Suite 500, Portiand, OR 97204. Another source of practical advice and materials are news- 
letters, such as Portfolio News, which was established by a network of educators in 1989 in order to fa- 
cilitate the exchange of information about the development and implementation of portfolio assessment 
projects (copies of the newsletter can be obtained from Winfied Cooper and Jon Davies, Editors, c/o San 
Dieguito Union High School District, 710 Encinitas Blvd., Encinitas, CA 92024). 

Examples of some of the methods being used to evaluate portfolios are listed below. 

• checklists 

• rating scales 

• participation charts/frequency counts 

• self-asessments (questionnaires or narratives) 

• peer evaluations 

• teacher informed judgments (anecdotal analyses/ outcome statements) 

• wholistic scoring scales 
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Alternative assessment, including the portfolio approach, is under study by the G>mpensatoiy Education 
Office of the California Department of Education. The office established a wwk group to examine the 
technical adequacy of mandated standardized tests for measuring the academic achievement of Qi^ter 
1 students, to identify the need for and supfwrting evidence for alternatives and improvements to current 
testing requirements in Chapter 1, and to recommend policy to guide the use of peifonnance-based 
assessments for California Chapter 1 svjdents. [For more information, contact: Jackie Cheong, Chair of 
the Assessment Sub-Committee, Compensatory Education Office, California Department of Education, 
721 Capitol Mall, Sacramento, CA 95814, Phone (916) 323-4775.] There are cuncnay eighty Chapter 1 
teachers field-testing portfolio assessments in English and/or mathematics in CalifcHnia [Contact Al Ko- 
shiyama at the Local Evaluation Unit, California Depann^nt of Education, 721 Capitol Mall, P.O. Box 
944272, Sacramento, CA 94244-2720. Phone (916) 324-7147]. 

Chapter 1 teachers and administrators are particularly concerned about if and how data from portfolio 
assessments can be quantified and aggregated to repon performance related to their program's desired 
outcomes. Meisels (1991) has suggested that teachers can aggregate pcntfolio information across groups 
of children to be able to make statements such as "80% of the children in the class can do [a specified 
activity]." He also sugges; s that teachers use a forced-choice procedure to place children into quartiles, 
e.g., top quartile or bottom quartile, in order to arrive at "a reasonably accurate description of how one 
child is doing compared tc others," 

In a paper presented at tltc Northwest Evaluation Association in August of 1990, Paulson and Paulson 
presented a "multidimensional, cognitive process model of assessment" designed to be broadly descrip- 
tive, while providing a framework for presenting high caliber quantitative and qualitative data. The 
Paulson and Paulson model, CMAP (Cognitive Model for Assessing Portfolios), is based on an inte- 
grated view of instruction and assessment Portfolio evaluation in this irodel is multidimensional to 
reflect the complexity of learning outcomes and to meet the needs of various "stakeholders." 

The Paulsons (April 1991) see the student as the primary stakeholder and self-evaluation as an important 
opportunity for him or her to reflect on his or her learning and develop "facility in using higher order 
thinking and metacognitivc skills." Portfolios also offer other stakeholders the unique opportunity to 
assess the higher level skills that constitute "the thinking curriculum." The Paulsons recommend that we 
use analytic techniques to evaluate portfolios that "preserve the complexity" of the learning that portfo- 
lios chronicle and that we use rating scales with great caution. When data are us«l for large scale ascss- 
ments, the Paulsons supfKJrt using techniques that ensure "rigor, impartiality, representativeness, and, 
above all, diversity." They describe two methods that meet these criteria and that can be adapted to the 
use of portfolio assessment- the Environmentai Beauty Estimation Method, used by the U. S. Forest 
Service, and the Comparative Method, used by sociologists. 

Teacher Response to Portfolio Assessment 



After surveying 128 elementary and secondary reading educators, Johns and VanLeirsburg (June 1990) 
reported that 71 percent of the teachers rated their level of knowledge of the portfolio concept as "very 
little" or "none." No one felt "extremely knowledgeable," and only 8 percent indicated they knew "quite 
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a bit" When given an axray of possible items to include in a portfolio and asked to rate those items, the 
item selected most frequently by these teachers was "a thoughtful selection of student work on important 
reading skills or strategies" followed by "writing samples related to reading" and "a listing of materials 
read." Only 35-43 percent of these reading teachers said that they would "definitely" or "probably" 
include audiotapes, videotapes, or photogr^hs in a portfolio. The teachers viewed these items as too 
lime-consuming, costly, or bulky to include. 

When asked to i?te possible practical problems in using portfolio assessment, nearly half of the teachers 
had "very serious" or "serious" concerns about planning, organizing, and managing inf(»mation using 
portfolio assessment. Nearly three-fourths of the teachers expressed souk concern with the issue of 
having portfolios replace standardized reading tests or achievement tests. The only aiea in which they 
did not have concerns was the use of portfolios in parent-teacher conferences. The teachers thought 
portfolios were ideal for showing parents what their children have accomplished in school over a period 
of time. 



The Need for Staff Development 



Teachers and administrators have many questions about the application and implementation of portfolio 
assessment. Professional development is crucial in addressing both those issues; ongoing staff develop- 
ment is essential in schools where portfolio assessment has been adopted. "Portfolio evaluation requires 
the careful planning and execution not only of the individual course, but also of a training program to 
support teachers using the system, thereby encouraging staff development. Benefits accrue to individual 
instructors, the students they teach, and the program in which they teach" (Bumham, 1986). 

Staff development on portfolios and other alternative assessment methods provides users with the 
information to ensure that these new assessments are developed properly. If not done well and inter- 
preted properly, data from perforaaance-based and other alternative assessment methods can be just as 
misleadii ^ and biased as results from traditional tests. Some of the pitfalls arc listed below (Arter, 
1991). 

• If the number of tasks included is too small, there may not be a true representation 
of what a student can do. 

• The individual biases of those rating the perforanance may affect die evaluation; 

• the criteria used to assess performance may not evaluate the most relevant and 
useful din^nsions of a task. 

• Some of the tasks that a student is asked to do can make one wonder what it is that 
is "natural" about performance assessment 

• There may be tilings in the performance assessment that make students unable to 
really demonstrate what they know or can do. 

New users may not understand the limitations and may, as a result, both design poor performance assess- 
ments and misinterpret the results thereof. Teachers need tiie opportunity to exp^^riment with portfolios 
and to have a voice in how and whether portfolios are used in their classrooms. As with change in any 
classroom practice, professional development needs to be a major part of the process (Mumme, 1990). 
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Integrating Reading Comprehension Assessment & Instmction 

Sample Strategies 

Before Reading 



Activating Prior Knowledge 
Reading Interview 
Word Associations 
Passage-Independent Questions 
Passage-Independent Vocabulary 

Predicting 
Yes/Nof Maybe Statements 
Brainstorming 

Setting Purpose 
Memory Retrieval Strategies 
KWL (What we know & what we 

want to find out steps) 
SQ3R (survey & question steps) 




During Reading 

Out Loud 
Think-Aloud Protocols 
Self-Corrections 
Miscue Analysis 

Cloze Tasks 

SQ3R (directed reading step) 

Coding Text 
Circling Key Words 
Underlining Key Concepts 
Marginalia 

Notetaking 
Cornell Method 
Herringbone Technique 

ReQuest/Reciprocal Teaching 




After Reading 



Free Recall 
Retelling 
Summarization 
SQ3R (recite & review steps) 
Story GrammarlEj^sitory Text Patterns 
Multimedia Responses 

Probes/Prompts 
Open-Ended Questions 
Story FramesfOutline Frames 
Semantic Maps/WebsfWeaves 

STaR (Story Telling ami Retelling) 
KWL (what we learned & still need to know step) 
Question-Answer Relationships (QAR) 
Quesiion-Answer-Detail (QAD) Chan 
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Integrating Reading Comprehension Assessment & Instruction 

Sample Strategies 



Before Reading 

Activating Prior Knowledge 
Reading Interview 
Word Associations 
Passage-Independent Questions 
Passage-Independent Vocabulary 

Predicting 
YeslNolMaybe Statements 
Brainstomung 

Setting Purpose 
Memory Retrieval Strategies 
KWL (What we know & what we 

want to find out steps) 
SQ3R (survey & question steps) 



During Reading 

Out Loud 
Think-Aloud Protocols 
Seff-Corrections 
Miscue Analysis 

Cloze Tasks 

SQ3R (directed reading step) 

Coding Text 
Circling Key Words 
Underlining Key Concepts 
Marginalia 

Notetaking 
Cornell Method 
Herringbone Technique 

ReQuest/Reciprocal Teaching 



After Reading 



Free Recall 
Retelling 
Summarization 
SQ3R (recite & review steps) 
Story Grammar! Expository Text Patterns 
Mu'timedia Responses 

Probes/Prompts 
Open-Ended Questions 
Story Frames/Outline Frames 
Semantic MapsfWebslWeaves 

STaR (Story Telling and Retelling) 
KWL (what we learned & still need to know step) 
Question-Answer Relationships (QAR) 
Question-Answer-Detail (QAD) Chart 
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Reading Interview 



It is important to find out what children know about their own processing of print materials. The fol- 
lowing two reading interviews ask children to identify good readers, to defme what it means to be a 
good reader, and to describe what strategies they themselves use when they can't read something. 

Teachers can use infwmation finom these interviews to assess children's awareness of the strategies 
they apply when reading. This metacognitive awareness of their own reading behaviors can help to 
identify successful strategies that students already know how to use and apply. It can also identify 
gaps in their knowledge and reveal situations in which pupils may have little or no knowledge of 
alternative strategies to use when they encounter difficulties reading. In addition, some interview 
questions can also supply teachers with information regarding children's areas of interest. This can 
provide a guide for selecting stories and books that will be especially motivating for particular 
individuals. 

How It Works 



The following questions can be used in developing reading interviews: 

Reading Experience Questions 

1. Do you like to read? Why or why not? 

2. Do you think you're a good reader? Why do you think so? 

3. Does anyone read to you at home? Who? 

4. When does someone read to you at home? 

5. Do you ever go to the library to get a book? 

6. Do people at your house like to read? What do they read? 

7. What kind of books do you like to read? 

Reading/Writing Awareness Questions 

1. What is reading? What does someone do when s/he reads? 

2. What are some good reasons for reading? 

3. How is reading different from writing? 

4. What are some good reasons for writing? 

5. When you read something, what is the main thing you should gel out of it? 

6. When you are reading, do you ever come to something that you don't know? 
What do you do? Is there anything else that you do? 

Show student the following cloze sentence before ask ing questions 7-8: 
CLOZE SENTENCE: The boy was down the hill to the lake. 

7. Can you read this sentence and tell me what word you would put in the blank? 

8. What did (could) you do to figure it out? Was there anything else that helped you 
know what it was? 
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How It Works (cont.) 

Reading/Writing Awareness Questions (cont.) 

9. Do you know someone who you think is a good reader? 
What makes him/her a good reader? 

10. Is there anything thai you think is difficult about reading? 

1 1 . When you write, what do you think is the most important thing to do? 

12. Do you think you are a good writer? Why or why not? 

Background Knowledge Questions 

1. Do you have any favonie stories? What are they? 

2. What do you like to hear or read stories about? 

3. Can you tell me a story that you know? 

4. When you are reading something, do you ever feel that you don't know 
CLOugh about the topic to understand what is going on? What do you do? 

5. What are some of your favorite things to do? 



Sample Interview 



A sample interview form is attached. 
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Reading Interview 

(Adapted frtm Reading Inurview by Carolyn L. Burke ) 

Name: Age: Date: 

1. When you are reading and you come to something you don't know, what do you do? 

2. Who is a good reader that you know? 

3. What makes her/him a good reader? 

4. Do you think she/he ever comes to something she/he doesn't know when she's/he's reading? 

YES When she/he does come to something, what does she^e do about it? 

NO Suppose that she/he does come to something that she/he doesn't know. 
Pretend, 

What do you think she/he does about it? 

5. If you knew that someone was having difficulty reading, how would you help them? 

6. What would a/your teacher do to help that person? 

7. How did you learn to read? 

What did (they/you) do to help you Icani? 

8. What would you like to do better as a reader? 

9. Do you think you are a good reader? YES? NO? Why? 
Additional Notesr 
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Assessing Prior Knowledge 



In the past decade, our models of reading comprehension have expanded greatly. Rather than a 
limited view of reading as a product or the sum of a discrete set of subskills, our cuxient research 
supported models look at reading comprehension as a process involving complex interactions be- 
tween the reader, the context, and the text 

... reading comprehension is viewed as the process of using the cues provided by 
the author and one's prior knowledge to infer the author's intended meaning. This 
involves a considerable amount of infcrcncing at all levels as one builds a model of 
the meaning of the text. (Johnson, 1984, p. 9) 

Comprehension is building bridges between the new and the known 

Comprehension is active not passive; that is, the reader cannot help but 
interpret and alter what he reads in accordance with prior I jiowledge about 
the topic under discussion. Comprehension is not simply a matter of record- 
ing and reporting verbatim what has been read. Comprehension involves a 
great deal of inference making. (Pearson & Johnson, 1978. p. 24) 

Our views of at-risk and disadvantaged learners are also changing, moving away from a deficit 
model which focused only on what was missing, inadequate, and unsuccessful (Knapp & Tumbull, 
1990) to a model based on the following principles (Means & Knapp, 199 1 , p. 7): 

• Appreciation for the intellectual accomplishments all young learners bring to school. 

• Emphasis on building on strengths rather than just remediating deficits. 

• Learning about children's cultures to avoid mistaking differences for deficits. 

Both the broader understanding of the comprehension process and the new way of looking at the 
learner emphasize the importance of prior knowledge. In a review of the research liteiature, Holmes 
and Roser (1987, p. 646) reponed that "prior knowledge is important for understanding, remember- 
ing, and interpreting text information Students with high levels of prior knowledge are better 

able to recall information presented. . . . [prior knowledge] seems especially helpful in answering 
inferential questions." Johnson (1984, pp. 29-33) advocated the use of assessment strategies that 
measure individual student's prior knowledge in order to detciminc if reading errors are due to lack 
of prior knowledge or failure to use available prior knowledge; he also discussed the importance of 
using assessment strategies to detect qualitative mismatches that might lead the reader to make inap- 
propriate inferences. 

Teachers need to assess prior knowledge in order not only to make more valid judgments about 
student performance, but also to plan instruction that best meets the needs of individual learners. By 
assessing prior knowledge, teachers have the information they need to help learners build bridges be- 
tween what they abeady know and the text. It also helps teachers know which students will need ad- 
ditional background information to help them better understand what they will be reading. 

H6 
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Assessing Prior Knowledge 



Sample procedures for assessing prior knowledge arc listed in the chart on the following page. The 
benefits and limitations of each procedure arc also included in the chart. Although they vary in the 
amount of information they generate and the ease of analysis of that information, each of the proce- 
dures can be used to find out what a student already knows in order to do the following: 

• develop lessons to build on the prior knowledge, 

• avoid unnecessary reteaching of ideas already familiar to the student, and 

• detect misinformation. 
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Procedures for Assessing Prior Knowledge 



PROCEDURES 


DESCRIPTIONS 


BENEFITS 


LIMITATIONS 


Passa^-Imtepcndeni 
Questims 


Student answers lest Items ^xuit a reading 
I^ssage whidi are bssei on tackground kiK^wl- 
edge ndher tfian parage nifcxmatkm 
(Johnson, 1984, p. 44-45) 


• Gives insights to whtt reader ^ready 
knew compared k> infcmnmiOT ^ned 
thrcHigh reading 

• May be used befcHC and after reading 


• Reqtrires well-written questicms 
which are h^hly relevant, but not 
covered mtf^ passage 


Passage-Indcpcndott 
Vocabulary Items 


Reacter responds to voc^Iioy words which 
reflect backgrcHind knowledge, but are not 
included ai ite |»sss^e 
(Johnson. 1984, p. 46) 


• Vocabulary knowK^ge correlate highly 
with reading onnprehension 

• Canbefffesemedina varK^tyd'formats 
(e.g., completion, multiple-choice, tnic- 
fatse) 

• Prim knowledge can be ct^ked with a 
few items 


• Vocdniteuy items mu^ be well- 
chmen 

• Cultural or socioeconomic 
differeno^ mifit be req)ected 


Free Recall 


Student supi^ies all he/^e knows about a vapic 
priOT to reding stiKlyii^ ^xnit il^ tcq^ic 
(Holmes & Roser, 1987. p. 647) 


• Requires liule time or prior preparation 

• Teacher can folkw up with a single 
probe {e.g., "Is that everything you can 
think of?") 


• Does not provide a complete picture 
of stuttent informatim and misinfor* 
mation 

• Can be difficult to interpret for 
instruction^ mirooses 


Word Association 


ReqxmJtng to a list of categmes or subtopics 
about the tt^ic being studied, ih^ student tells 
everything he/she can think of relied to thm 
topic c^tcgixy 

(Holmes & Roser, 1987, p. 648) 


• Quick and easy to prepare 

• Easy 10 administer 

• Yields more tnfmnaL^on than free 
recall method 

• Can be oral written 


• Do^ncH provide a complete pk:ttirB 
of student informdtk}n and misinfi»'- 
mation 

« Can be dinkrult to interpret for 
instnictional purpose 


Structured Questions 


Stnictured quesuon s are dcvek)ped to probe the 
categories or sid>topks related to the topic being 
studied; questions lange to indicate the depth 
the student's pric^ knowledge 
(nOimes oL Koser, ivor, p* wo/ 


• Elicits a qtmntity of correct and incor* 
rect inform^n 

» Ef rKTKsnt in terms of information pa- 
administration time 


• Questimis take considerable time to 
prepare (and orally administer) 


Unstructured Discussion 


The student is encouraged lo discuss his/her 
knowtedge and expmences related to the tc^c 
being studied 

(Holmes & Roser, 1987, p. 648) 


• Can be used to motivate snidents 


• Of limited help in Hnding out 
^udent's t^kgrmind knowledge 

• Can be time-consuming with 
limits information ^ned 


Ycs/No/Maybc Statements 


The ^udent predicts whether stmcmrats are 
likely to be included in a selection about a 
specified topic by a yes/no/maybe choice 
(Valencia & Ptarson, 1987, p. 730) 


• Can identify tx)th student information 
and mistnformaticm 

« Relatively quick and easy to prepare 
and admintslcr 

• Can be group administered 


• Relevant and distracts statements 
must be carefully chosen to 
maximize instructional interpreta- 
tion 
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Integrating Instruction and Assessment with 

Memory Retrieval Strategies 



Both insmiction and assessment require students to use memory skills and strategies. Reading com- 
prehension requires that readers constantly use and reorganize prior knowledge. Skilled rewlers use 
a number of strategies to encode information so it can be stored in the memOTy for later retrieval 
(Stoodt, 1981, p. 61). Four strategies that facilitate retention are rehearsal, chunking, mediation, and 
clustering. 

In Strategic Teaching and Learning: Cognitive Instruction in the Content Areas, Jones, Palincsar, 
Ogle, and Carr (1987, p. 36) discuss the following four variables teachers should consider in devel- 
oping instraction: characteristics of the leamer, material to be learned, goals and outcomes, and 
learning strategies- Under goals and outcomes, they include memory work, i.e., learning formulas, 
facts, etc. In order to reach instructional goals and outcomes, Jones et al. recommend a number of 
learning strategies that are based on the kind of material to be learned. Those strategies include the 
use of frameworks such as advanced organizers, concept hierarchies, semantic maps, etc. Those 
frame wOTks provide »Mganization and are often in the form of graphic outlines which aid memory 
storage and retrieval. 

Information that is stored in the memory is of little use unless it can be retrieved when needed. 
Memory and retrieval requirements are key factors that influence student performance on reading as- 
sessments (Johnston, 1983, p.34). Different kinds of test items call for different memory search 
strategies, i.e., multiple-choice items call on short-terra memory in order to compare alternatives, 
and a pairwise comparison strategy may improve success (Johnston, 1983, p. 35). 

It is important that instructors (1) teach stiategies that are appropriate to their content and goals/ 
outcomes and (X) -.nonitor students' knowledge of what the strategies arc, how to use them, and when 
and why to use them. Too often ". . • school objectives and tests ask for students to demonstrate 
their knowledge of a skill by actively using it in a school task, without asking them to demonstrate 
that they know what the skill or strategy is, or that they know when to use it or why it works." 
(Jones ei al-,1987, p. 41). In the following section is a brief overview of a number of memory stor- 
age/retrieval strategies. The strategies should be taught and monitored within the frameworic of the 
instructional or testing contexts. For example, mnemonic strategies might be appropriate for rote 
learning or for integration and assimilation of knowledge, but they would probably not be sufficient 
for restructuring of knowledge or for fostering concepnial change. 



How It Works 



ERIC 



Rehearsal" when students rehearse information by speaking aloud or using "internal speech," the 
review aids retention (Stoodt, 1981 , p. 62). Story retelling and think alouds arc strategies that 
employ a foim of rehearsal. (Think alouds with tests or individual test items can also indicate if stu- 
dents arc using appropriate memory enhancing strategies.) The Cornell Note-Taking and SQ3R 
study strategies include rehearsal steps. 
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Memory Retrieval Strategies 



Page 2 



How It Works (com.) 



Chunking" The short-tcnn memory holds an average of seven chunks (letters, words, or phrases) of 
information at a time (Sioodt, 1981, p. 61). The organization of information into "chunks" aids 
retention. 

Mediation- The more associations tha can be related to content, the more meaningful that content 
becomes, and hence more memorable. This is one reason it is important to assess prior knowledge 
and buikl on background information. 

Clustering" Information can be stored and retrieved from memory more readily when it has been 
organized or categorized. Graphic outlines and advanced organizers such as concept hierarchies 
and semantic maps use the clustering principle. Many samples are included in both Responses to 
Literature: Grades K-8 (Macon, Bewell, & Vogt, 1991) and Content Area Reading (Vacca & 
Vacca, 1986). 



Sample Concept Hierarchy 

Concept hierarchies can be used to organize information in a paragraph, section, chapter, unit, or 
course. The basic steps in developing a concept hierarchy are listed below (Vacca & Vacca, 1986, 
pp. 112-115): 

1. Analyze the vocabulary and list the important words (be sure to review any words in bold 
or italics as well as words listed at the end or beginning of the chapter). 

2. Arrange the list of words in a tree diagram (if the concepts are not related in a hierarchi- 
cal manner, choose a format that better reflects their relationships, i.e., chains are best for 
sequential information ). Place the word that represents the most inclusive concept 
(superordinate) at the top of the tree. Place the words that would represent the next level 
and are coordinate with one another on the major limbs of the tree. Place the terms 
subordinate to each of those terms on the branches of their respective limbs. (See figure 
on next page.) 

3. Evaluate to make sure the diagram encompasses all the relevant terms and that all the 
terms are on the appropriate levels. 

4. Incorporate new information as appropriate. 



A number of key words from a chapter in a typical science textbook are listed on the following page. 
Take five minutes to review those words using no memory strategies. Cover the list, and see how 
many of the words you can reproduce. Now take five minutes and review the concept hierarchy 
formed with those words. Cover the hierarchy and see if you can reproduce it. 



ERIC 
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Memory Retrieval Strategies 



Page 3 



Sample Concept Hierarchy (cont.) 

Key words from a typical science textbook: 

Animal Fish 

Amphibians Homo sapiens 

Birds Mammals 

Bovines Nonvenebratc 

Canines Vertebrate 

Cold blooded Wann blooded 
Equines 



This concept hierarchy was developed from the word list above: 



Animal 




Novenebrate 



Warm blooded 



Cold blooded 



Mammals Birds 



Fish 



Amphibians 




Bovines Canines Equines Homo sapiens 
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Integrating Instruction and Assessment with 

K-W-L 



Definition 



K-W-L is a strategy that models the active thinking needed when reading expository text. The 
letters K, W, L stand for three activities students engage in when reading to learn: recallJ-g what 
they already KNOW, determining what they WANT to know about the topic, and identiiyi g what 
they LEARN as they read. 

This strategy is designed to help students develop a more active approach to reading expository 
material. Teachers first model and simulate the kinds of thinking needed for learning and then give 
students individual c^jxwtunities to write out what they know, what questions they want answered, 
and what they have learned from reading the text. In this way, the benefits of group instruction are 
combined with individual student commitment and responsibility. 

The strategy was developed to translate current research findings about the active, constructive 
nature of leading into an instructional lesson format. In classroom testing, K-W-L has been shown 
to be an effective tool to help students become more active thinkers and to help them better remem- 
ber what they read (Ogle, 1986). It has also been useful in helping teachers better communicate the 
active nature of reading in group settings. 

The strategy is designed for group instruction and can be used with either whole classes or smaller 
groups. It can be used in all curricular areas and at all grade levels where students are reading ex- 
pository material. 

In addition to serving as an instructional activity, K-W-L can also provide teachers with assessment 
information. As teachers have students do the fu"st two steps, either as a group or individually, they 
become aware of what background knowledge their pupils have or don't have concerning a topic. 
Teachers can use this knowledge to enrich the sources of information they provide to students or to 
supplen^nt the text with additional explanations or demonstrations. They may also want to take 
more time to present topics about which pupils have little information or even have misinformation 
as revealed during the execution of K-W-L steps. 

How It Works 



Preparation. The teacher must prepare by reading the material, determining key content 
concepts that can elicit the most pertinent knowledge about the topic and by producing student 
worksheets. 

Group Instruction. The initial group portion of this strategy involves three basic compo- 
nents. First, the teacher engages students in a discussion of what they as a group already know about 
the concept the teacher has selected to introduce the lesson. The teacher lists this information on the 
chalkboard or overhead projector. When disagreements and questions emerge, the teacher notes 
them and suggests that students may want to include them on the center column as questions they 
want to have answered. 
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How It Works (cont.) 

Second, after students have volunteered all that they can think of about the concept, they 
should be asked to categorize the information they have generated. The teacher may need to identify 
one general category that incorporates two or more pieces of infonnation on the board to model the 
building of chunks or categories. (At this point, a teacher may also want to use a semantic map, as 
described in handout H-22 to categorize infonnation.) 

Third, after the students are somewhat <amiliar with this process, they should be asked to 
anticipate the categories of information they would expect to have included in an article on the topic. 
The categories of information identified will be useful in processing the infonmtion they read ?nd in 
future reading of a similar nature. 

Individual reflection. After the group introduction to the topic, students should be asked 
individually to write on their own worksheet what they feel confident they KNOW about the con- 
cept. They can also write down the categories they think are most likely to be included. At this 
time, the teacher should help students raise those questions that have emerged during the discussion 
or that come from thinking of the major categories of information they expect to find. Students 
should be able to think of at least three questions or issues that they WANT to Icam about as they 
read and should write those on their individual worksheets. 

Reading. Students should be directed to read the text, once they have focused both on what 
they know and what they want to find out from reading. Expending on the length and difficulty of 
the text and the class composition, the text can either be read as a unit or can be broken into sections 
for reading and discussion. As they read, students should use their worksheet, jotting down infomia- 
tion they learn as well as new questions that emerge. 

Assessment of learning. The final step in the process is to engage the students in a discussion 
of what they have learned from reading. Their questions should be reviewed to determine how they 
were resolved. If some have not been answered satisfactorily, students should be encouraged to 
continue their search for information. 



References 



Anderson, R.C. (1977). The notion of schemata and the educational enterprise. In R.C. Anderson, 
R.J. Spiro, & W.E. Montague (Eds.), Schooling and the acquisition of knowledge. 
Hillsdale, Hillsdale, NJ: Lawrence Erlbaum Associates, 

Anderwn, C.W., & Smith, E.L. (1984). Children's preconceptions and content-area textbooks. In 
G. Duffy, L. Roehler, and J. Mason (Eds.), Comprehension instruction: Perspectives and 
suggestions. New York: Longman. 

Ogle, D. (1986). The K-W-L: A teaching model that develops active reading of expository text. 
The Reading Teacher, 39, 564-570. 

C&I Specialty Option I PRC. Inc. 1 2601 Fortune Circle East. Suite 300A 1 Indianapolis. IN 46241 1 (800) 456-2380 



K-W-L 



What I already 
KNOW 


What I WANT 
to Know 


What I LEARNED 
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Integrating Instruction and Assessment with 

SQ3R 



There are many study methods which have been developed to heip students leara more from content 
area reading material. Francis P. Robinson (1946. 1961, 1962) developed the SQ3R method of 
effective study which is the "granddaddy" of most reading study methods which are taught. SQ3R is 
made up of the following five steps: Survey, Question, Read, Recite, and Review. 

Although originated in the 1940s, SQ3R incorpwates much of what current research tells us is im- 
portant in effective reading con^hension. It involves activation of prior knowledge, having a 
purpose for reading, self-monitoring (meiacognitivc) skills, and the manipulation of ideas and 
concepts by the reader using more than one sense. It is also easy to use SQ3R in conjunction with 
other study strategies. SQ3R is especially effective when coupled with the Cornell Note-Taking 
System since both strategies use the same basic procedures and structure for notes, although the 
order in which questions are developed is reversed. Text coding strategies (i.e., underiining or 
question response cues) and graphic organizers (i.e., semantic maps) can be incorporated in tiie 
reading, reciting, or reviewing steps. 

SQ3R is a proven method for increasing reading comprehension and retention. Part of the reason for 
its effectiveness is the time and effort it requires, but tiiat is also the source of the biggest difficulty 
with the strategy- getting students to use it. One solution is to start by using the approach with short 
reading assignments and gradually building comfort, facility, and stamina with the strategy. It is 
very important that students be taught to use SQ3R with relevant material that requires a thorough 
understanding and a systematic approach. 

The SQ3R strategy prcivides a great deal of diagnostic information about how a student is processing 
text. Students quite often have problems with the question step that are indicative of difficulties they 
are having with advanced skills in general. These problems may indicate a need for more explicit in- 
struction in summarizing, moving from examples to ideas, generalizing, etc. A teacher may need to 
model both the survey and question steps for several lessons. Teacher prompts and probing ques- 
tions can also help smdents generate effective questions. Teacher and student think alouds are 
anotiier effective means of teaching and momtoiing use of this strategy. 

SQ3R is a smdy strategy tiiat works well in an assessment program that stresses: 

• teacher constructed/conducted measurements 

• reading tasks using acmal classroom materials 

• evaluation that is folly integrated with instruction 

• identification of student strengths as well as instructional needs 

• incorporation and development of student self-evaluation 

• process measurements 

• ongoing and dynamic evaluation 

• the use of multiple tools, environments, strategies, and texts 

H9 
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SQ3R Readinft Strategy 



Page! 



How It Works 



1. SURVEY 

a. The first step is to read the chapter title and dctenninc what is already known about 
the topic. If a student is knowledgeable in the area, prior knowledge is used as a 
ftame of refoence and student and/or teacher builds on it. If the material is com- 
pletely new, the reading will take longer and the length of t!ie assignment may need to 
be reduced because a ftame of reference must be developed. 

b. The student reads the intioduction, and mentally notes the major points and the scope 
of the chapter. 

c. The student reads the major and minor headings throughout the chapter. 

d. After each heading, the student reads the first sentence of each paragraph looking for 
the main ideas for each heading. 

e. The student also reviews all exisiting study aids: graphs, pictures, diagrams, and 
study questions. 

f. Finally the chapter summary is read. 

This survey covers the whole chapter, but should not take very long. Tlie goal is to 
pre-read the material in order to identify the main ideas. By the time the survey step is fin- 
ished, the student has seen the main ideas (though in different forms) six times: generally in 
the title, more specifically in the introduction, even more specifically in the headings and 
topic sentences, graphically in the study aids, and again in the summary. Since one way 
we learn is through repetition, the ideas are likely to "stick". 

2. QUESTION 

a. Next, the student returns to the beginning of the chapter. He or she determines how 
much time there is remaining in the study period and sets a realistic goal, such d& 
finishing the first major section in the next hour. Goals should not be set so high 
that they cannot be achieved or the student will end up frustrated. 

b. The notebook page is divided so 1/3 of the space is on the left and 2/3s is on the right. 

c. The chapter title and headings are turned into questions. This helps to arouse 
interest and establish a purpose for reading and thus increases comprehension and 
concentration. 

d. The question for the chapter title goes at the top of the page, and the question for the 
first section goes in the in the left-hand column. 
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SQ3P Reading So-gtegy 

How It Woiks (com.) 



3. READ 

a. The student reads the material in the first section. 

b. The student underlines key words or phrascs( not whole sentences) which answer the 
question. Other text coding graphics arf used as appropriate, i.e., question response 
cues (Coley & Hoffman, 1990). Herringbones (Tiemcy, Readence. & Dishner. 1980), 
etc. If students may not write in their texts, the codes arc used with their notes in 
the recite step below. 

c- Any information which generates a new question or calls for revision of the 
initial quesdon is noted. 



4. RECITE 

a. After reading the section, the student should pause and reflect on the answer to the 
question(s) written (or revised) in die left-hand column. Then the question should be 
answered OUT LOUD without looking back at the text The answer should be checked 
with the text and written in the right-hand column opposite the question. 

Answers are not written in complete sentences but rather in brief, blocked formation. 
Ideas should be written in the smdent's own words, but include key terms and vocabu- 
lary from the text This step is a self-check that allows the student to find out what is 
not known or understood before ^he jgsl when something can still be done about it. The 
teacher uses this step for diagnosis to identify the need for intervention and supplemen- 
tary instruction. 

b. Steps 2-4 are repeated for each of the remaning sections in the chapter. 



5. REVIEW 

a. After reading all the chapter, the "working notes" should be reviewed to get the 
"whole picture" and see the inter-relatedness of the ideas. It might help the student 
to make a semantic map or a matrix to show the key points and their relationships. 

b. The student then covers the notes in the right-hand column, answers the questions in 
tiie left-hand column, checks for accuracy, and repeats the process to correct inaccu- 
racies. 

c. Subsequent periodic review is used to aid long-term memory. 



C&I Specialty Option f PRC. Inc. / 260J Fortune Circle East. Suite BOOA I Indianapolis. IN 46241 { (800) 456-2380 

1 . 



SQ3R Reading Strategy 



Sample $Q3R Reading Notes 

(With Question Response Cues & Herringbone) 



What IS the early history of 
labor movements'^ 



Labor Movement 



Began in U.S. ^ 

/660's ^ 

s/cw growth because oi ^ 

movement west 

high demand for fabor in ^ 

east 



Who were the Knights of Labor'^ 



Knights of Labor 

organized to help workers, 
fought for higher wages and 
shorter hours 
1 869 rapid growth 
100,000 workers in /68b , 
strikes led to decline 
disappeared by 1900 ^ 



1 im? 
2. im-86 
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Integrating Instruction and Assessment with 

Think Alouds 



Think alouds involve the teacher or the students talking out loud about their processing strategies - 
their thoughts while they are reading. They can be used by teachers to gain an awareness of the 
metacognitive leadingAhlnking strategies used or not being used by their pupils. 

However, they can also be used to assess how well students understand the author's text structure. 
The process of conducting a think aloud session can vary depending on the purix>se desired. Hie 
following guidelines are appropriate for a session focusing on the assessment of a student's under- 
standing of text structure. 

How It Works 

The actual text material you use for a think aloud session should be the normal text students are 
r^uired to read in your class. Tell students they will be reading a story or text that is mixed-up. 
Ask students to read each section of the text you have cut up at paragraph boundaries and shuffled. 
It is helpful to have each section color coded. For example, you might code the beginning dark blue, 
the middle yellow, and so on. That way, it will be relatively easy to relate students' think aloud 
commentaries with various sections of the story. To prepare the material for a session, simply 
Muffle the text sections into random order as you would a deck of cards. It is also a good idea to 
tape record the session for later analysis. 

It is helpful to introduce a student to a think aloud session so the process will go smoothly. The 
follow introductory script was adapted from Lyile (1982) by Bean (1988). 

Think Aloud Script for Assessing Text Structure Understanding 

I am going to give you a story (or text) to read and put together the way you, as an author, 
would write it. The stoiy (or text) is divided into paragraph sections that are mixed up. 
Call each section by the colored dot on it. 

Read each section to yourself silently. Tell me the color before you begin reading. 
Then read the section and tell me what you are doing and thinking about as you try to see 
where this section fits in the whole story. I will just listen and not nod or anything; in fact, 
this is more like talking to yourself -- "thinking aloud." I am interested in what you say to 
yourself as you read, what you are thinking about as you go along. 

After you have read the first color coded section and told everything you are thinking, go on 
to the next section mentioning its color. In a way, you are then telling what you are 
thinking about two sections of the story (or text), and then three, and so on - kind of news 
bulletins or play-by-play accounts of where you ai"e in your thoughts as you try to figure out 
how to put the story together so it makes sense. 
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Think Ahuds p^gg 2 

How It Works (cont.) 

If you get stuck or are having trouble understanding, I would like to hear about that too and 
try to Hgure out a solution to what's puzzling you. 

After you have read and talked about each section, and put the stoiy together the way you as 
an author think it should go, Td like to have you reflect for a while and then tell me your 
own sense of what the story was about. You can look back at the story if you like, but try to 
recall the basic ideas in your own words. 

While you are doing this, I wiU say nothing. I wiU have a small notebook open because I 
may want to write a few notes to myself -- things that occur to me as you talk about the 
story. I know I will have the tape to listen to, but I have found that I sometimes can't remem- 
ber ideas unless I write them. 

In order to illustrate the cse of think aloud protocols to observe and assess a student's sense of text 
structure, we will examine a scrambled story sequence of: 

The Accomplice 

• Phyllis hesitated, then raised her hand to tell Mrs. Hampton what she saw. Unfortunately, 
eight other hands also were raised in response to the question about the U.S. Constitution. 

"Jim?" Mrs. Hampton ignored Phyllis as usual, and Jim rambled on about various amend- 
ments. Meanwhile, the car thief was making his getaway in Mrs. Hampton's new red Supra. 

A highly skilled car thief stalked the faculty parking lot just after school staned. 

• Phyllis held her arm higher, cradling it in her other hand, but Mrs. Hampton continued to 
ignore her. Finally, she lowered her hand and stared at the vacant parking spot where Mrs. 
Hampton's car was only moments ago. She thought to herself that Mrs. Hampton would get 
a real surprise that afternoon and Phyllis would be there to watch. 

• Phyllis saw him through the window just as he jimmied the lock on Mrs. Hampton's new 
Toyota Supra. The man opened the door and stepped inside. [Bean, 1988, p. 104] 

Students are instructed to reorganize the segments into a normal story sequence that will be easier to 
comprehend. They can number the paragraphs sequentiaUy 1, 2, 3. etc. in the new oixier they would 
prescribe. Students who can sequence the scrambled story in the following order have a well devel- 
oped sense of scory structure. 

1. A highly skilled car thief . . . 

2. Phyllis saw him through the window . . . 

3. Phyllis hesitated, then raised her band . . . 

4. Phyllis held her arm higher . . . 
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Narrative structures typically contain the following major categories: setting, initiating event, 
internal response, attempts, consequence, and reaction. Searching for these categories in "The 
Accomplice," we can see that the setting is in Mrs. Hampton's classroom where Phyllis, our 
protagonist, is seen gazing out the window. 

Next we see Phyllis notice the car thief, thus providing an initiating event. We become aware 
of the initial internal response of Phyllis's concern and attempt to warn her teacher. This is 
followed by the consequence of the teacher ignoring Phyllis with the reaction that Phyllis's 
initial concern for her teacher changes to frasuation and then revenge. Phyllis lowers her hand 
and, in a sense, becomes an "accomplice" in the car theft. 

Some students will give a very brief think aloud merely saying, "I don't know. It looks okay 
the way it is ... I want to leave it the way it is." TTiis rel'- -stance to manipulate the passage may 
indicate little awareness of text structure patterns. Direct instruction using graphic organizers 
such as story maps (see Handout H22), can be used to help children develop these skills. 

Lytic (1982) developed a system for analyzing think aloud protocols by examining six moves a 
reader is likely to make w'^en attempting to comprehend a passage. These six moves are: 

1. Monitoring. I don't understand. This doesn't make sense. Manifested in 
statements or questions indicating the reader doubts his/her understanding 
(including conflicts). 

2. Signaling. What do I understand? Manifested in statements in which the reader 
signals his/her current understanding of the text's meaning (agrees, paraphrases, 
summarizes). 

3. Analyzing. How does this text work? Manifested in statements in which the 
reader, viewing the text as an object, notices, describes, or comments on the 
features of text (e.g., words, sentences, text structure, style). Thus, for the 
purpose of observing a reader's sense of text structure, we would expect to see 
this move occur within the think aloud process. 

4. Elaborating. What does this make me think of? Manifested in statements 
describing the ways the reader is responding to or experiencing the text such as 
imagery, recalling prior knowledge, Hking/disliking. 

5. Judging. How good is this? Manifested in statements indicating the reader is 
evaluating the text (ideas or text features). 

6. Reasoning. How can 1 figure this out? What might X mean? Manifested in 
statements or questions indicating the reader is trying to resolve doubts and 
interpret the text (e.g., hypothesis, prediction, question, use of evidence). 

It is helpful to ascertain students' use of several of these ways to analyze text structure using various 
kinds of passages, including expository as well as narrative text. 
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Integrating Instruction and Assessment with the 

Reading Miscue Inventory 



The Reading Miscue Inventory is based on a psycholinguistic view of the reading process. Reading, 
like the other language processes, is an interaction between sender and receiver with the intent to 
communicate. Due to the variables in both sender and receiver (experience, language, ethnicity, age, 
aptitude, interests, etc.) the exchange cannot be exact. In fact, to best understand another's ideas, we 
need to translate them to our own. Therefore, effective readers make positive miscues (deviations 
that retain the meaning of the text) routinely. This instrument is designed to help reveal pupil strate- 
gies and to serve as an evaluation tool for reading. It can help teachers determine specific patterns of 
pupil response when reading and can distinquish pupil difficulties from those caused by the organi- 
zation CH- content of the text. 

This informal procedure can serve a dual purpose: 

(1 ) to aid the teacher or other person serving as "Reading Instructor" by providing 
insights about the reading process; 

(2) to aid in providing productive activities for the student who is learning to read. 

The first objective will be emphasized most. It is based on the notion that when teachers more 
thoroughly understand the elements of the reading process and their interrelationships, they will be 
capable of creating and allowing reading experiences for students which capitalize upon the natural 
development of this and the other language skills. Persons who have a general understanding of the 
instrument and how it can be used to gather important information about the reader, will probably 
rarely need to use the instrument itself on any regular basis in the classroom. Their activities, inter- 
actions with children, and intuitive behaviors will embody the application of the inforaiation. The 
instrument merely opens up this avenue of perception. 

Hov^^ It Works 

In the basic steps, the teacher: 

1. selects a story and prepares a worksheet or coding sheet, 

2. explains the procedure to the reader, 

3. tapes the reading and retelling of the story, 

4. analyzes the retelling (see guidelines in the Story Retelling Handout HI 8), 

5. marks the worksheet or coding sheet, 

6. analyzes the oral reading performance, 

7. summarizes strengths and concerns, and 

8. plans subsequent instruction based on the last two steps. 



1 . «~) 
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Diagnosis of reading miscues can be done on a number of levels as described below; 

LEVEL A As^ss comprehension from independent reading. 

Student reads new materiaU uninterrupted, independently, 

in the preferred mode (silent, oral, alone, etc.) and then retells the 

story into a tape recorder. 

LEVEL B Assess semantic acceptability or oral performance 
and comprehension. Student reads new material, 
uninterrupted, into the tape recorder, then retells the story 
(also on tape). 

LEVEL C Identify specific behaviors or strategies used by the 

student while reading. Use the recorded reading sample 
from LEVEL B or obtain a new one including reading and 
retelling for assessment of comprehension, semantic 
acceptability, and specific behaviors. 

LEVEL D 1 ) Scoring the retelling (character development, events, 
plot, theme) 

2) Sentence-by-sentence analysis of strategies used 
during the process, and 

3) Deeper analysis of substitutions (graphic 
similarity, syntactic acceptability, semantic accept- 
ability). 

The following questions can be used to guide analysis of the retelling and reading: 
Comprehending 

1. Does the retelling information indicate understanding of the story? 

2. Is the reader concerned with getting meaning from print? 

3. Does the reader produce sentences which follow acceptable sentence structure and make sense 
Proficient Readinp Strategies 

4. When the reader produces substitution miscues which are not similar to the text in terms of 
grammatical function (i,e., a noun for a noun), do these miscues often occur in structures 
which are grammatically acceptable? 

i.ii 
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Proficient Reading Strategies fcnnt.^ 

5. When the reader produces niiscues with no graphic similarity, do these miscues often 
make sense (high quality miscues)? 

6. When the reader produces miscues which do not fit the sentence structure or do not 
make sense, does the reader connect them? 

Inefficient Reading Strategies 

7. Does the reader correct miscues which do not result in a change of meaning? 

8. When producing substitution miscues, does the reader overuse phonic information 
at the expense of meaning? 



The Reading Miscue Inventory procedure is used to analyze each miscue or discrepancy the pupil 
makes when reading a text orally (Goodman & Burke, 1972). Nine basic questions are asked to de- 
termine which language cueing system the pupil is predominantly depending upon when reading: 
graphic similarity, syntactic acceptability or semantic meaning. The following nine questions are 
asked of each miscue: 

1. DIALECT. Is a dialect variation involved in the miscue, e.g., "I be going" for "I am 
going"? 

2. INTONATION. Is a shift in intonation involved in the miscue, e.g., "Mother called 
you." for "Mother called. You ... . "? 

3. GRAPHIC SIMILARTIT. How much does the miscue look like what was expected, 
e.g.. "horse" for "house"? 

4. SOUND SIMILARITY. How much does the miscue sound like what was expected, 
e.g., "redder" for "reader"? 

5. GRAMMATICAL FUNCTION. Is the grammatical function of the miscue the same 
as the grammatical function of the word in the text, e.g., "maybe he could go" for 
"maybe he would go"? 

6. CORRECTION. Is the miscue corrected, e.g., "I got on the brick, no -- bike" for 
"I got on the bike."? 

7. GRAMMATICAL ACCEPTABILITY. Does the miscue occur in a structure which 
is grammatically acceptable, e.g., "he saw something" for "he saw nothing"? 
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How It Works (cont.) 



8. SEMANTIC ACCEETABILTY. Does the miscue occur in a structure which is seman- 
lically acceptable, e.g., "down the street" for "down the road"? 

9. MEANING CHANGE. Does the miscue result in a change of meaning, e.g., "I don't 
have tim" for "I don't have time"? 



Reference 



Goodman, Y. M., & Burke, C. L. (1972). Reading miscue inventory manual: Procedure for 
diagnosis and evaluation. New York: Macmillan Publishing Co., Inc. 
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Integrating Instruction and Assessment with the 

Cloze Procedure 



The Cloze Procedure requires readers to fill in words that have been deleted fhsm a reading passage. 
It has been used to assess the readability of passages for children. It can also be used to assess 
student reading strategies in order to plan appropriate instrucdon. 

How It Works 
TO CONSTRUCT: 

1. Select a passage of at least 275 words. Leave the first and last sentences intact. 

2. Delete words in a sequential pattern, substituting blanks of equal length for the deleted words. 
Usual patterns of deletions arc; 

lower grade levels = every tenth word 
upper grade levels = every fifth word. 
Fifty blanks are needed to provide a statistically reliable score. 

3. Encourage the students to fill in each blank as they read the passage. 
TO SCORE: 

1 . While il^ere is debate over whether to score only exact replacements as correct or to allow 
synonyms as correct, it is generally recommended that scoring be based on exact word re- 
placements for ease of implementation. Research has indicated that overall percentages 
change very little whether synonyms are counted right or wrong, but validity and reliability 
ratings are only applicable to scoi^s using exact word replacements. Research has indicated 
that deleted content woids (nouns, main verbs, and adjectives) may be more difficult to pro- 
duce as cloze items than structure words (Hittleman, 1973). 

2. Compute the percent of blanks correctly completed. Readability levels are scored as: 

Independent Level = Qjirectly replaces 61 % or more 
Instructional Level = Correctly replaces 41 % - 60% 
Frustration Level = Correctly replaces 40% or less 

TO INTERPRET: 

1 . Cloze percentages can be used to match readability of text materials with the student's 
reading level. 

2. Review the words the student used in completing the passage. Did the word choices result 
in meaningful sentences? Did the word cho'ces maintain the original meaning of each sen- 
tence? Was the gist or general meaning cf the passage maintained throughout? How did the 
student's word choices change the meaning of the passage? What clues do the word choices 
provide about how the student interacted with the text? 
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TO INTERPRET (com.): 

3. Review the student's word choices in relation to the syntax of the passage. What cues from 
the sentence structure did the student use in choosing words? Are nouns substituted for 
nouns, verbs for veibs? Are singular and plural clues used as well as verb tense clues? 
How well did the student use sentence structure clues to help maintain meaning? 

4. Use the cloze technique to examine how the student handles different types of text materials, 
such as narrative text, content text, and reference or information text. 

5. Use cloze to screen groups of students for particular materials, instnictional activities, or 
units of study. 

Although the CLOZE PROCEDURE provides useful information, ii should not be the only pro- 
cedure used to assess comprehension. 

Jongsma (1971) did extensive research on the cloze procedure and discovered that as a teaching 
device without any foUowup, it had little or no value in "teaching" comprehension. However, 
students' comprehension did improve when students discussed their answers on cloze passages, 
i.c., explaining why one answer was chosen over another. Teachers have found the cloze proce- 
dure useful for assessing students' reading abilities prior to assigning them books or literature 
materials for which no other tests exit. 

Standard Cloze Sample 

An example of a cloze passage and answer key are included on the following pages. Tliere are 
several variations to the standard format as already noted. Two frequently used variations are 
described below. The variations have the advantage of being less frustrating to students, and, there- 
fore, the scores are less a factor of persistence or stamina. Think alouds are a good way to find out 
not only what strategies students are using to make word choices but also to monitor frustration 9nd 
effort levels. 

Maze Technique 



In this variation, students can choose a response from a set of possible answers containing distrac- 
tors. 

Example: Jeff put the ice cream into a dish. 

fuelling 
making 
matching 

Limited Cloze 



In this variation, the words randomly delete from the passage are put into a scrambled order and 
listed in the margin. Students can then choose words to fill in the blanks from the list of actual 
words listed in the margin. 

^ C&I Specialty Option I PRC, Inc. 1 2601 Fortune Circle East, Suite 300A I Indianapolis, IN 46241 / (800) 456-2380 

ERIC 120 



Cloze Procedure 



Page 3 



Cloze Example 



Remarks by the President at the Presentatation of the National Education Strategy on April 
18, 1991, from: America 2000: An Education Strategy Sourcebook. 

For those of you close to my age, the 21st century has always been a kind of shorthand for the 
distant future -- the place we put our most far-off hopes and dreams. And today, that 21st 1 is 

racing towaid us - 2_ anyone who wonders what 3 century will look like 4 find the 

answer in 5 classrooms. 

Nothing better defines 6_ we are and what 7 will become than the 8 of our children. To 

9 the landmark case. Brown v. 10 of Education, "It i s 11 that any child ma y 12 be 
expected to succeed 13 life if he is 14 the opportunity of an 15 . " 

Education has always meant 16 . Today, education determines not 17 which students will 
succeed, 18 also which nations will 19 in a world united 20 pursuit of freedom in 21 . 
Think about the changes 22 ourworM. The collaps e 23 conmiunisro and the Col d 24 . The 
advent and acceleration 25 the Information Age. Down 26 history we've defined resources 

27 soil and stones, land 28 the riches buried beneath. 29 more. Our greatest nation al 30 
lies within ourselves - our 31 . ingenuity - the capacity of 32 human mind. 

Nations that 33 ideas will move forward 34 years to come. Nations_15_ stick to stale old 
36 and ideologies will falter 37 fail. So I'm here 38 to say, America will 39 forward. 
The time for 40 the reports and rankings, „41_ all the studies and 42 surveys about what's 
wrong 43 our schools is passed. 44 we want to keep 45 competitive in the coming 46 . 
we must stop convening 47 to report on ourselves. 48 must stop convening panels 49 repon 
the obvious. And we must accept responsibility for educating everyone among us, regardless of 
background or disability. 



1. 

2. 

3. 

4. 

5. 

6. 

7. 

8. 

9. 

10. 

11. 

12. 

13. 

14. 

15. 

16, 



17. 
18. 
19. 
20. 
21. 
22. 
23. 
24. 
25. 
26. 
27. 
28. 
29. 
30. 
31. 
32. 



33. 
34. 

35. 
36. 
37. 
38. 
39. 
40. 
41. 
42. 
43. 
44. 
45. 
46. 
47. 
48. 
49. 
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Cloze Example (cont.) 

Remarks by the President at the Presentatation of the National Education Strategy on April 
18, 1991, from: America 2(X)0: An Education Strategy Sourcebook. 

For those of you close to my age, the 21st century has always been a kind of shorthand for the 
distant future the place we put our most far-off hopes and dreams. And today, that 21 si century is 
racing toward us ~ and anyone who wonders what the century will look like can find the answer in 
America's classrooms. 

Nothing better defines what we are and what we will become than the education of our children. To 
quote the landmark case. Brown v. Board of Education, "It is doubtful that any child may reasonably 
be expected to succeed in life if he is denied the opportunity of an education." 

Education has always meant opportunity. Today, education determines noi just which students will 
succeed, but also which nations will thrive in a world united in pursuit of freedom in enterprise. 
Think about the changes transforming our world. The collapse of communism and the Cold War. 
The advent and acceleration of the Information Age. Down through history we've defined resources 
as soil and stones, land and the riches buried beneath. No more. Our greatest national resource lies 
within ourselves ~ our intelligence, ingenuity ~ the capacity of the human mind. 

Nations that nurture ideas will move forward in years to come. Nations that stick to stale old 
notions and ideologies will falter and fail. So I'm here today to say, America will move forward. 
The time for all the retwns and rankings, for all the studies and the surveys about what's wrong in 
our schools is passed. If we want to keep America competitive in the coming century, we must 
stop convening panels to report on ourselves. We must stop convening panels that report the obvi- 
ous. And we must accept responsibility for educating everyone among us, regardless of background 



or disability. 










1. century 


17. 


just 


33. 


nurture 


2. and 


18. 


but 


34. 


in 


3. the 


19. 


thrive 


35. 


that 


4. can 


20. 


in 


36. 


notions 


5. America's 


21. 


enterprise 


37. 


and 


6. what 


22. 


transforming 


38. 


today 


7. we 


23. 


of 


39. 


move 


8. education 


24. 


War 


40. 


all 


9. quote 


25. 


of 


41. 


for 


10. Board 


26. 


through 


42. 


the 


11. doubtful 


27. 


as 


43. 


in 


12. reasonably 


28. 


and 


44. 


If 


13. in 


29. 


No 


45. 


America 


14. denied 


30. 


resource 


46. 


century 


15. education 


31. 


intelligence 


47. 
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32. 
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Integrating Instruction and Assessment with 

Text Coding Strategies 



Question re^xmse cues, undeiiining, circling key words, and making marginal notes are a few of the 
coding metbods students can use to enhance their ability to get meaning fstm text. Each of these 
strategies icquires students to spend extra time processing infom:iation in die text which aids reten- 
tion. Since using these methods involves some classification of text inf(mnation. they involve 
deveIopn»nt of simple schema which facilitate retrieval. The text coding strategies also engage stu- 
dents in problem solving to the degree that they have to make decisions about the relative impor- 
tance of pieces of information in the text and xecognize relationships among those pieces of iiiforma- 
tion. Reasoning (problem solving) is a large component of reading comprehendon (Johnston, 1983, 
p. 1 1-13, 34-35). Both reasoning and njcmoryActrieval are also important factors in many reading 
comprehension assessment tasks. 

Teachers can use text that students have coded for diagnostic purposes, i.e., as the basis for deter- 
mining instructional needs. In fact, most students can profit fipom some explicit instruction in how to 
identify important information in the text, supraordinaie and subordinate ideas, and other relation- 
ships (such as cause/effect). Teacher think alouds are one way of providing that explicit instruction. 

Underlining 



Although it probably does not facilitate retention to the degree done by strategies such as SQ3R, se- 
mantic maps, or story frames tiiat require more complex processing and .lestructuring of text infor- 
mation, underlining yields to some degree all of tiie benefits listed in the first two parEgraphs of this 
handout It can also be used effectively as a preliminary step in creating a semantic map, a struc- 
tured overview, or one of the other more complex strategies. Where students are not allowed to 
underline in school texts, the underlining strategy can be used effectively with their class notes and 
handouts. Basic guidelines for underlining include the following: 

• Read a paragraph or section at a time. 

• DO NOT start underlining until you have finished reading the paragraph ot section. 

• Ask yourself what that selection is about and what words or concepts you should 
understand. 

• EJecide how you want to underline different kinds of information, i.e., a solid line 
might indicate a term and a squiggly line a definition. Be consistent in how you 
use tiiose codes in this and future readings. 

• ONLY underline words and short phrases. Do not underline whole sentences or 
groups of sentences. 

• If several examples are given, connect tiiem with arrows or lines. 

• Read just the underlined words, and ask yourself if they convey the important 
ideas and concepts in the paragraph or section. If not, underline any additional 
material that is necessary. 

• Go on to die next paragraph or section, and repeat the process. 

H13 

4th grade & up 

C&l Specialty Option I PRC, Inc. 1 2601 Fortune Circle East, Suite 300A /Indianapolis, IS 4624 J f (800) 456-2380 



Text Codmg Strategies 



Fage2 



Underlining (cont) 

In additioQ to using different kinds of lines for specific kinds of infonnation, as suggested in the 
guidelin«, students can develop other customized gnq)hic codes to fit their individual needs, ic, a 
student might always circle important dates, put boxes around fonnuias, etc. Customizing codes 
makes it caao" to scan text later for specific kinds of infonnation and gives students practice in de- 
veloping and using categories. The question response cue system described in the next section of 
this handout is basically an extension of this type of strategy. 

The coded passages arc a record of student thought processes that can be used by the student and/or 
teacher to analyze performance and identify instractional needs. Using this and other strategies does 
take extra time, and that effort is only valid for purposes of instruction or evaluation when there is a 
compelling need for a student to understand and retain the material being coded. 

Question Response Cues 



In the September, 1990. issue of The Journal of Reading, Janice Evans Knight described a set of 
question response cues developed by Lynoan (1987) to remind smdents and teachers "to ask each 
other a variety of questions on different types of tiunking." The graphic cues were initially devel- 
oped as a reminder for teachers that they needed to assess reading comprehension beyond the literal 
lecaU level. Lyman expanded his model to help siudsaia develop questioning skills, to promote 
higher level tiiinking, and to encourage the use of metacognitive strategies by using the cues as a 
framewoik for asking and answering con^rehcnsion questions. Knight added to Lyman's system a 
set of cues and procedures specifically for coding and assessing students' reading response journals. 
The cue codes are placed in the margins of the entries. Her Journal of Reading article includes de- 
tailed explanations of die codes and how she teaches die cues to her middle school smdents one at a 
time in minilessons, using teacher modeling and student practice with "real" reading purposes and 
materials. The article also includes several examples of coded journal entries. A list of the codes 
used by Knight and samples of coded entries are attached to this handout. (See Coley & Hoffman, 
April 1990, for information about uang question re^nse cues with at-risk sixth grade readers.) 
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Text Coding Strategies 

Question Response Cues 



Pages 



Codes Developed by Lyman to Cue Questions or Responses 

CODE DEFINITION EXAMPLES 



Recall 
facts 

plot design 
sequence 
detail 
summary 



• TeU sequence of events in 
Ransom ofRedchief. 



(X) 



Compare 
analogy 
ratio 

similarity 



How are the causes of the Revolution 
and the Qvil War similar? 



Contrast 
difference 
distinction 
discrimination 
d^fferentiatic n 



• How is a rhombus different from a 
parallelogram? 

• How is a mammal different ftom a 
reptile? 



0 



Cause<— >Effect 
cause 

effect/result 

consequence 

irference 

prediction 

hypothesis 



What are the effects of teasing? 
What do you think causes a rainbow? 
What would happen if the earth rotated 
only once a year? 



Idea to Example 
analogy 
categorization 
deduction 



From our list of stories, find some 

examples of friendship. 

Is that a case of propaganda? Why? 



Example to Idea 
classification 
induction 
conclusion 
generalization 
finding essence 



What is the main theme of this story? 
What are some character traits of 
Dorothy? 



7\ 



Evaluation 
value 
judgment 
rating 



• Was Ahab right to push on after the 
whale? Why? 
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Text Coding Stnuegies 

Question Response Cues (cont.) 
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Procedural Codes for Journals Added by Knight 



CODE DEFINmON 

C H Choosing a book 

/t 3 Abandoning a book 

R, R, Rereading a book 



Process Strategy Codes for Journals Added by Knight 



s 


Summarizing 




Activating Prior Knowledge 


p 


Predicting 


MV 


Mentally Visualizing 


<— R 


Reread a Passage for Clarification 


R—> 


Read Ahead for Qarification of Points 


pe 


Relating Personal Rtperiences 


GO 


Graphically Organizing Information 


SQ 


Self-Questioning 


C 


Consulting a Knowledgeable Source 


Sk 


Skimming 


MP 


Monitor Par' of Reading 



Special Assistance Codes for Journals Added by Knight 

Q Nothing (not passage specific, didn't really read the passage, didn't under- 

stand it, etc.) 

9 

Student Confusion 
X Wrong Information Recorded 

" 
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Text Cmiing Strategies 

Samples of Coded Journal Entries 



Pages 



A coded exceipt from Doug's reading response journal- 



I » • • 

Za Za Aqofha Christie is a good descriptive writer. But, she writes 
about Old, 'rich" people, t think maybe she hasn't seen 
the hard life. She probably grew up as a wealthy, goody 

S/-» £ X 900dy child. fRom the picture on her book she looks that 
way, with the big ring on her finger, the pearls around her 
neck and the fluffed collared neck on her dress. The book i 
started reading was about a wealthy H star navy com- 
mander taking a trip to the Caribbean! H I Just didn't like it 
and so l abandoned it. 



A coded excerpt from Amy's reading response journal- 



in language class we are reading Romeo and Juliet i en- 
" Joyed what we read in class so much that I decided to read 
some on my own last night, l got so involved in it that I 
ended up finishing it. 

Ever since I can remember i have known of the play, but 
^ r< I never had any idea what it was about except that it was a 
love story. 

Some parts were very confusing, but whenever I came 
to a part that didn't make sense, I would refer back to the 
Q book Airs, fibers gave us that has Romeo and JuUet trans- 
lated Into modern English. It was pretty helpful. 

/\ /\ f really loved the play. Before I read It, l thought it would 
be Just some boring romantic play that a crazy man wrote. 
-i- Now that I've read it, it is a lot more. Shakespeare uses 
p lots of symbolism and personification. 

One example of personification is: '/iias that love, 

9^£ j( whose view is muffled still, should without eyes see path- 
ways to his will.' All Romeo is saying In this speech is that 
those who are in love do not see the faults of those they 
love— love is band. 

Romeo says to Juliet, 'Hush, I see light coming through 
that window up above. The light comes from the east and 
0->6x '^^^^^^ the sun.' As an example of symbolism Romeo also 
^ says, 'The night is like a cloak and I hide in its darkness.' 



12b 
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Text Coding Strategies 

Samples of Coded Journal Entries (cont.) 
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A coded excerpt from Dinars reading response journal- 

Run. Sf?e//ey. Run fs starting to get good. But I don't under- 
stand how her mother could be like that, so cold. She 
doesn't even want her own daughter any more. And then 
they put her in homes. She runs. They put her back. She 
runs. Then the cops arrest her for no reason. The shelters 
don't even treat her like a person. I get in a lot of trouble 
and sometimes I wonder if that could ever happen to me. It 
Is kind of scary. I feel sorry for kids like that. But sometimes 
I think they could make things better If they tried. 



Coded excerpts from two students' reading response joumals- 

^ I'm on page 368 of The Tommvknockers . So far It's been 
0 Interesting. I was going to abandon It but It is becoming 
better. 



I have Just finished reading The Black Caldron . I found it 
just as Interesting as The Hi oh Kino . I'm looking forward to 
reading more books in the series. 



(An examination of the kinds of codes on several pages should give a good indication of typical 
levels of a student's response. The codes that are few or missing indicate areas which should be 
exploFcd-possibly the student needs to be guided toward other ways of thinking about what is 
being read or the student may have difficulties with other levels of comprehension and need 
teacher intervention (instruction, guided practice, etc.). For example, the last two samples are 
typical of student entries when they begin writing response journals. The teacher might use the 
"evaluation" cue to prompt the first student to explain what made the story become more inter- 
esting. The "compare" cue might be used to prompt the second student to explain the ways the 
stories are alike, and the "contrast cue" might be used to prompt an explanation of how they are 
different. 

By examining the codes in a number of res|x>nse journals, the teacher may discover that he or 
she is asking students to respond in only a limited way and needs to make a more conscious 
effort to address the full range of comprehension levels.] 

Source of the samples: Knight, J. E. (September 1990). Coding journal entries. Journal of Reading, 
M(l). 45-46. 
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Integrating Instruction and Assessment with the 

Heiringbone Technique for Note-Taking 



Successful readers possess the following three types of knowledge: strategic, content, and metacog- 
nitive (Johnston, 1983, p 14). Strategic knowledge is the ic p e nol re of rules, procedures, and routines 
that make leaniing more efficient Content knowledge is the background infarmation or prior knowl- 
edge learners have about the subject and the WOTld in general Metacognitive knowledge is the infor- 
mation learners have concerning the state of their own knowledge and learning process. Note-taking 
strategies are tools sSudsiU& can use to organize content in a text (strategic knowledge) and monitor 
their learning (metacognitive knowledge). Note-taking strategies also yield a written record of 
student thought processes that can be used by a isiSilSI in assessing reading comprehension and 
planning related instruction. 

While note-taking strategies provide schemas which aid retention and recall, they require varying 
degrees of pricar knowledge about expostory text structures (cause/effect, ccmiparison/contrast, 
chronological, problem/^lution, etc.) and content to be effective. Teachos need to plan for instruc- 
tion in these areas as well as explicit instruction, modeling, and guided practice in note-taking strate- 
gies. Note-taking can also be used very effectively in conjunction with text coding strategies such as 
underlining. 



The Herringbone Technique 

The Heiringbone technique provides students with a structure for taking notes fxam a textbook 
chapter, for observing relationships, and for studying and remembering information (Tiemey, Read- 
cnce. & Dishner. 1980). It is comprised of six basic comprehension questions- Who? What? 
When? Where? How? and Why? Students read a selection and record their answers to the questions 
in the framework shown below. Students record unfamiliar terms in the left-hand column. 




Herringbone Techaquefbr Note-Takmi 
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For many students, the quantity of information contained within a twenty-page content ch^to- can 
be overwhelming. By providing this stmcture, a content teacher can assist stud«its in remembering 
the important information within the chapter. The written record provides the basis for future study 
of the lecoided information and gives both student and teacher diagnostic infonnation about the 
student's reading comprehension. That information can then be used in planning subsequent instruc- 
tion. 

The Heningbone technique can also be used very effectively in conjunction witii a more inclusive 
study strategy such as SQ3R or the CotbcU note-taking system. When the text material does not 
contain information organized in the Herringbone categories or it is not impfHtant for smdcnts to 
understand and retain infonnation at this level, the technique would be inappropriate. 

How It Works 



The classroom teacher prepares for instruction by answering die following questions: 

(1) What are the major concepts diat I want my students to understand at the 
conclusion of this chapter? 

(2) What are the important vocabulary terms that relate directly to these 
nnajor concepts? 

(3) How will my students learn this information? 

(4) Which of the identified concepts do 1 expect my students to master? 

Completing tiiis preparation step gives the teacher a perspective as to what infomMtion ^^ill be 
important as the students are guided in the use of the Herringbone procedure. 

Following appropriate prereading strategies to activate prior knowledge and address gaps in back- 
ground knowledge, the classroom teacher models die note-taking technique by putting the Herring- 
bone form on a transparency and displaying it on a screen for all students to see. As the whole class 
"walks through" die strategy, the teacher writes the information on the transparency as the students 
fill in their own copies of the fonn. This "walk-through" or modeling procedure may involve only 
the first couple of chapter subtopics or the teacher and snidents naay complete the whole chapter to- 
gether. 

After the students understand the stmcture of the Herringbone form, they are ready to begin the 
reading and recoiding process themselves. The students are advised to read the infonnation seeking 
answers to the questions as they are listed below (the questions appear in a shortened version on the 
Herringbone itself). 

1 . Who was involved? (Answer should yield the name of one or more 
l^rsons or groups.) 

2. What did this person or group do? 

3. When was it (the event discovered in (Question 2) done? 

4. Where was it done? 

5. How was it accomplished? 

6. Why did it happen? 
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How It Works (cont) 



The questions may need to be slightly modified for different texts, content areas, and reading pur- 
poses. By wQiidng tlrough the procedure and recording their answers, students should discover the 
important relation^ps among the pieces of informati(»i. 



Examples 



For a chapter on "The War against Germany" in a United States history text, students were advised 
to read the first main topic and recOTd their answers to the six key questions (Tiemcy ci al, 1980). 
The following Herringbone is an example of those produced for the first main topic, "The United 
States Enters the War": 



Roosevelt^ ^ 
^ Churchill ^ 

Main Idea 



1- us. 



^ir ' Entered WWII 
-^\y n 
sx'i^* y^ 2 . Decided on ^ 
Allied/^ 



1 . J2mj 

2. Late 194 J 




! , ??????? 



1 . ??????? 



2 In 

Washington 



2. European 
Axis first 



Japan attacked 
Pearl Harbor 

2. Germany 
more powefid 
than Japan 



Some subtopics will yield more than one important set of facts, as this example illustrates. Others 
may provide only one important piece of infomiation. 

Note also in the above example that two tcmis ("AlUed" and "Axis") which might cause some prob- 
lems with some students were noted on the left-hand column of the form. By instructing students to 
record unfamiliar terms, the teacher discovers those terms which, even though they may have been 
prctaught, are confusing to the students and thus need to be taught, retaught, emphasized, and/or 
reinforced. 



Tiemey et al. (1980) also describe ways the Herringbone strategy can be used to develop more ad- 
vanced skills and to reinforce the use of multiple sources of information. In the chapter on "The War 
Against Germany," students recorded the following information on their forms: 

Who? Germany 

What? Invaded U.S.S.R. 

When? June, 1941 

Where? Leningrad, Moscow, Stalingrad 

How? 

Why? Thought could capture Russia < o 
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Examples (com.) 



As with this example, textbook authors often do not provide all the infonnation necessary to answer 
all the questions. In some instances the particular bit of infonnation may not be impoitant; in other 
instances it may be very significant The Herringbone fomi provides students and teachers alike 
with a visible display of infonnation "gaps.*" It allows students and teachers to use analytic and 
evaluative skills to determine the importance of the missing information. If the missing infonnation 
is deemed impcmant, then students may be asked to infer the missing information and/or to pursue 
the answers through the fcHmation of research teams and the examination of other resources. 

Other answers provided by the text authors would be pursued in the same way. For example, the 
text authors' answer to the question, "Why did Gmnany invade the U.S.S Jl.?" might be considered 
rather superficial. The authc^ simply state that Germany invaded the U.S.S.R. because Germany 
thought it could capture Russia. The classroom teacher might want to extend the search for under- 
standing by asking, "But why did Germany think it could capture Russia?" or "What other reasons 
might Germany have had?** Predictions could be made by the students, followed by attempts to 
search out information in other sources to confirm or deny those predictions. 

Finally, the Heiiingbone form contains the term "Main Id^" on its midline. After the students have 
completed the chapter and their outline, they are asked to make a statement that would represent the 
main idea of the chapter. Using the history book example, the teacher might ask, ''What one state- 
ment can you make that would teU what the authors are saying about the war against Germany?" A 
comprehensive response might be, The war was long and costly in terms of nioney and lives, but 
eventually resulted in the defeat of Germany by the Allied Forces." Teacher prompts or probing 
questions are needed to help students develop such a main idea statement until student have suffi- 
cient experience with summarizing, translating examples into main ideas, and generalizing. 
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Integrating Instruction and Assessment with the 

Cornell Note-Taking System 



Note-taking is an indispensible skill for secondaiy students. Researchers have established that when 
students take notes on reading assignments, they can retain and recall more infomiation. However, 
some note-taking systeois are mxxc efficient and effective than others. Rather than copying text 
verbatim, it is bener to use a strategy or corolnnadon of strategies that involve the following: 

• relating prior knowledge to new content; 

• using schema/graphic organizers (i.e., semantic maps) 
that fit the text stracture, fadlit^e summaiization, and 
depict relationships among ideas and concepts; 

• developing questions for self-checking; etc. 

Note-taking strategies that include the charactoistics listed above are a means of developing better 
comprehension and metacognidve skills. They also yield a wrinen record of the student's thought 
processes that can be used by the student and/or teacher to identify comprehension problems and 
plan appropriate instruction. In assessing student notes, two key questions are (1) "Have the essen- 
tial concepts and supporting details been noted?** and (2) "Has the material been organized in a way 
that it can be easily reviewed and recalled?" Reviewing notes periodically with a student is a very 
important procedure since it does the student no good to be reviewing incomplete or inaccurate 
information. You may find students need further instruction in finding main ideas, summarizing, 
ide* itifying text structures (i.e., causf^effect, problem/solution), etc. Hie review also gives the 
teacher a chance to ask the student to explain how he or she chose what was important and how 
both right and wrong answers were derived. 

The Cornell Note-Taking System 



The Cornell system of note-taking is a study skills strategy that can be taught and applied in all 
content areas. Although designed to be used with a lecture, it can also be adapted for use with a 
textbook. In the Cornell method students take notes on a portion of each page leaving the remaining 
space blank. They then read their notes (whether taken from a lecture or reading) looking for main 
ideas and supporting details which are subsequently recorded in the blank space and used for self- 
quizzing. The process requires students to b^ome more actively involved with the material and to 
review key information several times; both practices increase retention rates. The self-checking step 
also develops metacognidve skills. 

It is often effective to use underlining and text coding strategies in conjunction with the Cornell 
system as a step between note-taking and developing the margin cues. Other graphic organizers 
(i.e., semantic maps) and coding systems such as question-response cues (Knight, 1990) can also be 
veiy useful. Another variation of this note-taking strategy is the double entryAcsponsc journal 
strategy described by Coley and Hoffman in the April, 1990, issue of the Journal of Reading. 

mondary 
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Steps in the Cornell Note-Taking System* 



1. Use one noteboA wiih loosc-Ieaf paper per class. 

2. Be prepared for class. Read the assigned material (preferably using the SQ3R method or other siuly strategy 
for high leteniion) and pwe» the niaerial by taking notes. Hiese notes not only sctvc as a record of the main 
concepts in the chapiw, bifl also provide a fiame of lefercnce for material presented in the lecture. 

3. Review mxcs takoi from reading n^oeiial immediately before tte class begins. This refreshes the memory and 
helps to eliminate distractions Qriiyskal or moital). 

4. When class starts, have pen and paper ready. Put other mai«ials away, stop conv«saiions, and focus your 
attention on the teacher. 

5. Use only the fiont of )©ur pag^, leaving the backs for commoits, ideas, rewc^king of notes, etc. 

6. Draw a verucal line dividing each page so proximately 1/3 of the space is to the left of the line and the 
remaining 2/3s arc to the right On the right-hand side of each frage. you will take the notes in class. The left- 
hand side of e^h page is left blank until all the notes are taken. 

7. Take your noi« in the large section of the page. Get as much of the lecture as you can. You need not try for a 
liiemy pattern or Jttyle; all you want to do is take enough notes so you will be able to remember and review 
what the teacher said days or weeks later. (Use abbreviations siwingly.) 

If you miss something, leave a line or box as a place holder that can be filled in later by consulting the text, the 
teacher, or a fellow student. 

8. As soon after the lecture as possible, read your notes. Fill in any missing or incomplete information. Make 
"scribbles" more legibte. 

Use underlining, graphics, and/or colored pencils to identify key information. Be consistent in your use of these 
codes, i.e., use a squiggly line only for definitions, so when you ^ the squiggle you know what kind of 
information is there. Avoid doodling. 

9. Write the main points and cue woffds in the teft-hand column. Whenever possible write them in the form of 
questicms, so they can be used fctf self-quizzing. 

10. Review by covering the large action of your notes and then, using your summary/questions, see if you can 
recite the notes which arc covered up. Do this OUT LOUD for the best results. 

Uncover your notes and check your recall. Reread secticsis of the notes you cannot recall and repeat the 
pnxress. Review as often as you need to, but do this first review within 24 hours for best retention. 

1 1 . During the week before an exam, go through the same process for each page of notes, tying them all together by 
your reviews. 

12. Right before your exam, review all the material in all your left-hand columns as a final iwqjaration. This is an 
excellent kind of last-minute cramming -- it gives you a lift right when you need it most, and it takes only a few 
minutes. 

♦ These steps will need to be slightly modified for note-taking from a textbook rather than a lecture. 



ERIC 
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What is CONfLICr? 



conflicfA reso\uilon= 27 
conflicf=reso!ufion=? 
What is EKfernal coniiici? 



What is fNfernal conflict? 
Whof is SUSPENSE? 



What is fORESMDOW I NG? 



Some stories make us want to read them. 
Conflicp Is Q struggle ^tween opposing 
fojtct^s. If conflict is not resolved, we feel 
frustrated and angry. When conflict is ^ 
r^so/vedWe feel good. 



iternal coi^U^ is a stw^c^ between the 
\harQCter and some out sjde^f^rce. 
Internal cor^Uc) is within thejihor^ct^r. 
(ouspense)/s the QP^Qus_curlqsity of 
wanting to know whgtjrtapgens _ne%t. 
Hints andslu^s <^bout whaij/iJl happen are 
CQlled(wreshadowing. 
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Integrating Instruction and Assessment with 

Reciprocal Teaching 



Reciprocal teaching is an instructional activity that can also be used to assess children's understand- 
ing of text. It takes place in the form of a dialogue between teachers and students regarding seg- 
ixMsnts of text. The dialogue is structured by the use of four strategics: summarizing, question 
generating, clarifying, and predicting. The teacher and students take turns assuming the role of 
teacher in leading this dialogue- 
Strategies 

Summarizing provides the opportunity to identify and integrate the most important informa- 
tion in the text. Text can be summarized across sentences, across paragraphs, and across the passage 
as a whole. When students first begin the reciprocal teaching procedure, tiieir efforts are generally 
focused at the sentence and paragraph levels. As they become more proficient, they are able to 
integrate at the paragraph and passage levels. 

Question generating reinforces the summarizing strategy and canies the learner one more 
step along in the comprehension activity. When students generate questions, they first identify the 
kind of information that is significant enough to provide the substance for a question. They then 
pose this information in question form and self-test to ascertain that they can indeed answer their 
own questions. Question generating is a flexible strategy to the extent that students can be taught 
and encouraged to generate questions at many levels. 

Clarifying is an activity that is particularly important when woridng with students who have a 
history of comprehension difficulty. These students may believe that the purpose of reading is 
saying the words correctly; they may not be particularly uncomfortable that the words, and in fact 
the passage, are not making sense. When the students are asked to clarify, their attention is called to 
the fact that there may be many reasons why text is difficult to understand (e.g., new vocabulary, 
unclear referent words, and unfamiliar and perhaps difficult concepts). They are teught to be alert to 
the effects of such impediments to comprehension and to take the necessary measures to restore 
meaning (e.g., reread, ask for help). 

Predicting occure when students hypothesize what the author will discuss next in the text In 
order to do this successfiilly, students must activate the relevant background knowledge that they 
already possess regarding the topic. The students have a purpose for reading: to confirm or disprove 
their hypotheses. Furthermore, the oppormniiy has been created for the students to link the new 
knowledge they will encounter in the text with the knowledge they already possess. The predicting 
strategy also facilitates use of text structure as students learn that headings, subheadings, and ques- 
tions embedded in the text are useful means of anticipating what might occur next. 

In summary, each of these strategies was selected as a means of aiding students to construct meaning 
from text as well as a means of monitoring their reading to ensure that they are, in fact, understand- 
ing what was read. 
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How It Works 



Reciprocal teaching should be introduced to students with some discussion regarding the many 
reafi)ns why text may be difficult to understand, why it is important to have a strategic approach 
to reading and studying, and how the reciprocal teaching procedure will help the students under- 
stand and monitor their understanding as they read. Thus, students play an integral part in 
assessing the effecdveness of their own reading and comprehending strategies. 

The students are then given an overall description of the procedure, emphasizing that it takes the 
form of a dialogue or discussion about the text and that everyone takes a turn assuming the role 
of teacher in this discussion. To illustrate, the person who is assuming the role of teacher will 
first ask a question that he or she thinks covers important information that has been read. The 
other members of the group answer that question and suggest other questions. The "teacher" 
then summarizes the information read, points out anything that may have been unclear, leads the 
group in clarifying, and, finally, predicts the uix;oming content. Having students take on the 
role of "teacher" has been found to give them a new appreciation for the work a teacher does. 

To ensure a minimal level of competency with the four strategics, the students receive practice 
with each of them. For example, the students summarize their favorite movie or television 
shov. They then identify main idea infora^tion in brief and simple sentences and graduate to 
more complex paragraphs that initially contain redundant and trivial information. Each strategy 
receives one day of introduction. 



Application 



After the students have been introduced to each of the strategies, the dialogue begins. For the 
initial days of instruction, the adult teacher is principally responsible for initialing and sustaining 
the dialogue. This provides the opportunity for the teacher to provide further instruction and to 
model the use of the strategies in reading for meaning. The adult teacher may wish to call upon 
more capable students who will serve as additional models, but it is important that every student 
participate at some level. For some students, this participation may be such that they are noting 
one fact that they acquired in their reading. This is a beginning, and over time the teacher, 
through modeling and instruction, can guide these students toward a more complete summary. 

As students acquire more practice with the dialogue, the teacher consciously tries to impart 
responsibility for the dialogue to the students while he or she becomes a coach, providing the 
students with evaluative information regarding the job they are doing and prompting more and 
higher levels of participation. Thus, in addition to providing the teacher with information 
regarding student's understanding of what was read, this procedure also passes along informa- 
tion to students regarding ways to assess their own understanding of what they read. 
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Integrating Instruction and Assessment with the 

ReQuest Procedure 



Background Information 

The ReQuest Procedure involving reciprocal questioning was developed by Anthony Manzo (1969) 
to guide students through a text and enable them to comprehend the net of the passage successfully. 
The ReQuest Pnxcdure is designed to improve the student's reading comprehension by providing an 
active learning situation for rhe devclcq)mcnt of questioning behaviors. The teacher encourages th^i 
student to ask questions about the text material and to set his/her own purposes for reading. The 
ReQuest Procedure was originally devised as a procedure involving an individual student and the 
teacher, but it can also be utilized with pain, teams, and/or small groups. 

The procedure can also be used by teachers for diagnostic and assessment purposes; by noting the 
kinds of questions a student asks for each kind of text structure, a teacher can determine whether the 
student is comprehending. Through teacher modeling of good questioning behavior, the student 
gains insight into how good readers ask themselves questions as they are reading. Students should 
practice the ReQuest procedure on both short and long reading passages to develop self-monitoring 
skills. Students should be encouraged to ask questions that will stimulate interpretive or applied 
levels of thinking, such as questions on the main idea of the passage. In addition, the procedure can 
be used to encourage the exchange of content information and ideas. 

How It Works 

The ReQuest Procedure consists of the following steps: 

1. The teacher chooses a story or passage to be read by the student and the teacher; 
content area texts and prose materials woric equally well. Both the student and the 
teacher need copies of the reading materials. 

2. Both the student and the teacher silentiy read the selection. The selection can be read 
one sentence at a time or a paragraph at a time. 

3. After they have both read the passage, the student asks as many questions as possible. 
The teacher answers the questions clearly and completely. 

4. Then it is the teacher's turn to ask the questions about the same senter.ee or paragraph, 
and the student answers as fully as possible. By forming questions which call upon 
the student's grasp of text stmctures, the teacher models good questioning strategies. 

5. When the student has finished answering, teacher and student read the next sentence 
or paragraph and proceed as before. 
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How It Works (cont.) 



6. When the student has processed enough information to make predictions about the 
rest of the selection, the exchange of questions stops. The teacher then asks directed 
reading type questions: ''What do you think the rest of the assignment is about?" 
"Why do you think so?" The student reads the rest of the assignment. 

7. The teacher facilitates follow-up discussion of the material. 

The ReQuest Procedure encourages students to frame their own questions about the reading 
materials, a strategy that has been shown to increase reading comprehension. By taking on the 
role of questioner, students tacitly discover information sources in the passage and, as a by- 
product, develop the useful habit of self-questioning. Teachers can assess growth in their 
students' ability to take on this more responsible questioning role. Direct observations have 
indicated that students learn how to do the ReQuest Procedure willingly and easily. (Helfeldt 
& Henk. 1990). 
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Integrating Instruction and Assessment with 

Story Retelling 



Stoiy leteUing is basicaUy having a student recall out loud the stoiy {or text) he or she has just read 
or heaid read. The retcUing strategy can be used for both assessncnt and instruction. As a diagnos- 
tic tool. ictclUng can be used for assessing comprehension of text and stories as weU as understand- 
ing of story structure. It can also be used for assessing language abiUty, although that application is 
not discussed in this handout. [Sec Morrow (1988. pp. 134-35, 145-47) fw an overview of the pro- 
cedure and a sample assessment] When story retelling is used for assessment, it is very in5)ortant 
that students are told beforehand that they will be retelling the stOTy and to which story elements 
and/or comprehension processes they should attend, i.e., they should be told to be relating personal 
experiences and feelings to the reading if use of prior knowledge is being measured. 

Retelling can also be used as an instructional strategy to improve comprehension, recall, and sense 
of story structure. Retelling is a form of verbal rehearsal, and, as such, it improves recall and com- 
prehension and enables students to plan, organize, and apply processing abilities more effectively. A 
modified version of story retelUng is a strategy called STaR, Story Telling and Retelling, (Karweit, 
1989; Karweit & Coleman, 1991). STaR has been one of the keystone instructional strategics in 
Success for All. an effective Chapter 1 early intervention program (Madden, Slavin. Karweit. Dolan, 
&Wasik.l991.p.595). 

According to Morrow (1988. p. 137). "HoUstic in its approach, concept, and effect, retelling con- 
trasts with the more traditional piecemeal approach of teacher posed questions that require students 
to respond with splinters of information recalled from text" Since reteUing is less structured than 
teacher questions, students have to use advanced skiUs to determine what elements to include in their 
retelling and how to organize those elements. "Hie teacher gains more insight about what a student 
on his or her own attends to; however, just because a student does not include an element or concept 
docs not mean he or she missed it For that reason, teachers often need to use prompts to elicit addi- 
tional information. Several examples of prompts are included in the next section. Prompts are 
especially important at first because the retelling format has rarely been used in classrooms, and it is 
not something that comes easUy. The reteUing strategy requires modeling and guided practice. 
Props such as felt boards, graphs, and picnires that help cue the story events and elements are espe- 
cially effective for young children. Post discussion improves a student's subsequent retellings. 

The retelling strategy is time consuming. Once mastered, however, it is an excellent activitiy for co- 
operative learning groups. A more sophisticated version of reteUing is used in teach-reteach strate- 
gies where a student who has been taught information in turn "teaches" it to another. Like peer 
tutoring, both the smdent who is teaching and student recipient of the teaching learn from the experi- 
ence. 



How It Works 



Guidelines for eliciting and coaching a child's reteUing are Usted on the next page. Guidelines and 
samples of quantitative and qualitative assessments of story retelling follow. ^ 
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Prompts to Elicit Story Retelling 



1 . Tell Ae child that after reading (or hearing) the stoiy, he or she will be asked to retell it 
as if to a firiend who has never heard it before. If you aie looking for particular elements 
of comprehension, you should tell the child to attend to those, i.e., when looking for 
sense of sequence, say the following: 

"/»ay close attention to the order in which things hempen in the story, " 

2. After the smdcnt reads or listens to the story being read, ask him or her to retell the story 
by saying the following: 

"A Utile while ago. you read [or heard] the story (name the story). Would you 
retell the stary as if you were telling it to a friend who has never heard it before?" 

3. Use the following prompts only when n«;essary: 

If the child has difficulty beginning the story retelling, suggest beginnuig with 
"Once upon a time ..." or "Once there was " 

If the child stops retelling before the end of the story, encourage continuation by asking, 
"What comes next?" or 'Then what happened?" 

If tiie child stops retelling and cannot continue with the prompts offered, ask a question 
about the story that is relevant at that point in the story at which the child has paused, i.e., 
"What was Jenny's problem in the story?" 

4. When a child is unable to retell the stoiy, or if his or her retelling lacks sequence and 
detail, prompt the retelling step by step. For example: 

"Once upon a time . . . or "Once there was " 

"Who was the story about?" 

"When did the story happen?" (day, nig'.t, summer, winter) 

"Where did the story happen?" 

"What was the main character's problem in the story?" 

"How did she try to solve her problems?" "What did she do first/next?" 

"How was the problem solved?" 

"How did the story end?" 



(Ad^ned from: Morrow, L. M, (1985). Retelling stories: A strategy for improving young children's comprehension, 
concept of story structure, and oral language complexity. Elementary School Journal. SI (5), 647-61 .] 
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Story Retdling 

Using Retelling to Identify Story Structure 



Retelling can both reveal and develop the student's sense of stoiy structure. A schematic for story 
structure facilitates comprehension because it gives the student a basis for predicting stoiy elements. 

The four elements most generally included in a stoiy structure schematic arc setting, theme, plot 
events, and resolution. The following steps are used to develop the assessment (adapted from Mor- 
row. 1988, pp. 132-33): 

1. Parse the story into the following four units: setting (includes characters, time. & place) 

theme 
. plot episodes 
resolution 

2. Tell the student that he or she will be asked to retell the story, and he or she should 
attend to the setting, theme, main events and the order in which they occur. 

3. Following reading, ask the student to retell the story. Note the number of idea 
units included (regardless of order). 

4. Give credit for partial recall or getting the general gist of the unit. 

5. Compare sequence of events recalled to the parsed text 

The assessment information is used to identify areas to develop through instruction and guided 
practice. In Responses to Literature: Grades K-S , there are a number of "engagement activities" 
designed to help students "tiiink, focus on meaning, and consider die literary elements of a story" 
(Macon, Be well, & Vogt, 1991, p. 1). The engagement activities are based on schemata such as: 
story frames, plot relationship charts, story maps, story summaiy tables, character maps, and story 
pyramids. 



Sample of Story Structure Assessment 



The schemata listed above for engagement activites can be used for diagnostic purposes. Another 
format to use to assess stoiy structure recall from story retelling is included on the next page. See 
Morrow (1988, pp. 142-44) for an example of a parsed story, a verbatim transcript of a five-year- 
old's retelling of the story, and the assessment of that retelling using this form. 
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Sample Assessment of Story Structure Recall 



Student Age 

Title of story Date 

Directions: Place a 1 next to each clenaent if the student includes it in his/her retelling. Credit gist 
as well as obvious recall, counting boy, girl, or dog, for instance, under characters nanied, as well as 
Nicholas, Mei Su, or Shags, Credit plurals {Lt.^ friends ) as two. 



Sense of Story Structure 



Subscoies 



Scores 



Setting 



a. Begins story with an introduction 

b. Names main character 

c. Number of other chararters named 
Actual number of other characto^ 

Score for other characters (# named/ actual #) 

d. Includes statement about time or place 



Theme 



Refers to main character's primary goal 
or problem to be solved 



Plot Episodes 



Number of episodes recalled 
Number of episodes in story 
Score for plot episodes (# recalled/ actual #) 



Resolution 



a. Names problem solution/goal 

b. Ends story 



Sequence 



Retells story in structural order: setting, 
theme, plot episodes, resolution. (Score 2 for 
complete match, 1 for panial) 



Highest score possible 



Student's score 
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Quantitative Procedures for Assessing Retelling 



Page 5 



In a quantitative assessment of stoiy retelling to measure reading comprehension, the teacher parses 
the story (or text) into units. The retelling is parsed in the same units, and the two are compared 
(Morrow, 1988, pp. 131- 132). The procedure measures how well the student recalled what was read, 
i.e., facts, sequence, main ideas, and supporting detail. If the parsed units are assigned rating levels, 
a measure of the student'" ability to distinguish between elements based on their importance can be 
obtained. Guidelines for developing and interpreting a quantimtive assessment of story retelling are 
listed below: 

1. Divide the passage to be read into units of your own choosing - for instance, by phrases or 
clauses. Mark the end of each unit with a slash. Be consistent in your unit definitions and 
divisions from passage to passage. 

2. On a sheet of paper, list your units in sequence, with empty lines to the left and to the right 
of each unit, forming three columns down the sheet 

3. Assign each unit a number from 1 to 3 and write the number in the blank to the left of 
each unit: 1 for an important unit like a main idea, 2 for a moderately important unit, and 
3 for an unimiK>itant detail. 

4. Tell the student you will be asking him or her to retell the story after reading or listening to it. 
Make your purpose explicit, 2.e., if you want to measure the student's recall of sequence, tell 
him or her to pay attention to the order of events. 

5. Let the student read or listen to the story in its original format, then ask the student to 
retell it (use prompts ONLY if your purpose is instruction rather than assessment). 

6. Record the student's retelling on tape. 

7. Analyze the student's recorded retelling by numbering the units on the right hand side of your 
guidesheet in the sequence in which the student has recalled them. Leave a blank by those 
units the student did not recall. (If recall was prompted, indicate that with a "p" next to the 
sequence number, and include the number of prompted responses in your analysis.) 

8. Compare the sequence in which the student has recalled the units with their sequence in the 
original story. 

9. Tabulate the number of units the student recalled. 

10. Note the assigned level of importance of each unit the student recalled. 

1 1. To quantify the data, divide the number of recalled units at each level of importance by 
the total number of units at that level in the original story. The resulting three percentages 
indicate how closely the student's comprehension is biased toward the more important units. 
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An extension of the assessment would be to have the student explain what he or she thought were 
important story elements and why. This activity gives the teacher the opportunity to assess mciacog- 
niiivc skills, reasoning, inferencing, use of prior knowledge, etc., and it becomes the basis for subse- 
quent instniction. 



Sample of Quantitative Assessment 



A sample of a quantitative assessment of story retelling is attached ("Sample of Quantitative Assess- 
ment of Recall"). Before examining the sample in detail, cover up the left-hand column with the unit 
ratings and rate the stoiy units for yourself (using the rating definitions in step 3 of the guideUnes). 
Compare your ratings to those in the sample. It is likely that there will be some variation. Despite 
some degree of subjectivity in rating the units, your responses that did not match the sample would 
have been counted "wrong" if they had been items in a traditional comprehension test, and you 
would have likely been judged a less competent reader than is the case. The story retelling prxxre- 
duie decreases the likelihood of drawT^ such erroneous conclusions because it ^lows you to exam- 
ine both the assessment and the reader in context of the task. 



Qualitative Procedures for Assessing Retelling 



In a qualitative assessment of story retelling to measure reading comprehension, the teacher focuses 
on comprehension levels beyond literal recall, i.e., ability to generalize, use of prior knowledge, 
inferencing, use of schemata, etc. (Morrow, 1988, p. 132). The teacher uses a procedure similar to 
the holistic grading system developed by Cooper (1977) and Meyers (1980) to evaluate written com- 
positions. The holistic system is now being used to evaluate the essay sections in several national 
and statewide testing programs, e.g., the GED (General Educational Development ) Tests. The 
holistic assessment approach makes sense for programs stressing reading and writing to leam in real 
contexts rather than learning to read or write in programs stressing isolated subskills. 

Sample of Qualitative Assessment 



An example of a format for conducting qualitative assessments, "Qualitative Assessment: The 
Retelling Profile," is attached. The profile was developed by Irwin and Mitchell (1983) and is in- 
cluded in Lesley Mandel Morrow's chapter, "Retelling Stories as a Diagnostic Tool," in Reexamining 
Reading Diagnosis: New Trends and Procedures (Glazer. Searfoss, & Gentile, 1988, pp. 140-41). 
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Sample of Quantitative Assessment of Recall 

Student: Billy, Grade 4 

IMPORTANCE PAUSALUNTT RECALL 

RATING FOR SEQUENCE 
UNTT( IsiiKm imponani } 



3 


1. The three were growing tired 


1 


3 


2. from their long journey 


2 


1 


3. and now they had to cross the nver. 


3 


2 


4. It was wide and deep 




1 


5. so they would have to swim across. 


4 


1 


6. The younger dog plunged into the icy water 




3 


7. barking for the others to follow him. 




3 


8. The older dog jumped into the water. 




2 


9. He was weak 




2 


10. and suffering from pain. 




2 


11. but somehow 




1 


12. he managed to struggle to the opposite bank. 




3 


13* The poor cat was left alone. 


5 


1 


14. He was so afraid 


6 


2 


15. that he ran up and dawn the bank 




2 


16. wailing with fear. 




3 


17. The younger dog swam back and forth 


7 


3 


18. trying to help. 




1 


19. Finally, 




1 


20. the cat jumped in 




3 


21. and began to swim near his friend. 




2 


22. At that moment, 




2 


23. something bad happened. 




2 


24. An old beaver dam from upstream broke. 




1 


25. The water came rushing downstream 




2 


26. hurling a large log toward the animals. 




2 


27. It struck the cat 


9 


1 


28. and swept him helplessly away 





ANALYSIS 



Total number of units = 28 
Number of units recalled = 9 
Percentage recalled = 32% 

1. important units (main idea) 3/9 = 33% 

2. moderately important units 2/9 = 22% 

3. unimportant details 4/9 = 44% 



Student includes approximately as 
many unimportant details as impor- 
tant/modemtely important units. 

Sequence of recall is excellent 
(subjective judgment based on good 
sequence of recall in the retelling) 
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Qualitative Assessment: The Retelling Profile 

Directions: Indicate with a checkmark the extent to which the reader's retelling includes or provides 
evidence of the following information. 

LOW MODERATE HIGH 





NONE 


DEGREE 


DEGREE 


DEGREE 


L Retelling includes information directly stated in text 










^« Ac&cuing inciuac5 uuQxiiiauon mierreu uirecuy or 
indirectly from text 










0. Kciciiing uiciuoes wnai is imponant to rememoer 
from the text 










4. Retelling provides relevant content and concepts. 










5. Retelling indicates the reader's attempt to connect 
background knowledge to text information. 










6. Retelling indicates reader's attempt to make sununary 
statement or generalizations based on text that can be 
appueu to tne real worio. 










7. Retelling indicates highly individualistic and creative 
impressions of or reactions to the text. 










8. Retelling indicates the reader's affective involve- 
ment witn the text 










9. Retelling demonstrates appropriate use of language 
\vuv.BDUidry, senicnce struciure, language conventions;. 










10. Retelling indicates the reader's ability to organize or 
compose the retelling. 










1 1 . Retelling demonstrates the reader's sense of audience 
or purpose. 










12- Retelling indicates the reader's control of the 

n^echanics of speaking or writing. j 











Interpretation: Items 1-4 indicate the reader's comprehension of textual information; items 5-8 
indicate metacognitive awareness, strategy use, and involvement with text; items 9-12 indicate 
facility with language and language development 

[P. A. Irwin & J, N. Mitchell's profile. From: Morrow, L.M. (1988). Retelling stories as a diagnostic tool. InS. M. 
Glazer, L. W. Searfoss, & L. M. Gentile (Eds.), Reexamining reading diagnosis: New trends and procedures (pp. 140- 
41). Newaric.DE: International Reading Association.] 
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Integrating Instruction and Assessment with 

Expository Text Structures 



Assessing students' use of expository text structures can provide valuable infonnation concerning 
their ability to use text features to aid their con^irehension of passages. Unlike familiar narrative 
passages, where the text has grown out of stories with structures based on an oral tradition, the 
complex expository passages detailing scientific and social science information can be difficult for 
students to understand. 



The six most common expository patterns that students encounter in their texts include the following 
(Readence, Bean. & Baldwin, 1985): 



1. Cause/Effect, This panem links reasons with results. It is characterized by an inter- 
action between at least two ideas or events, one taking an action and another result- 
ing from that action. Social studies texts often use this pattern. 

ample. The heavy snowfall prevented the climbers from going to the top of the 
mountain. 



2. Comparison/Contrast. This pattern discusses and illustrates apparent likenesses and 
differences between two or more things. 

Example. Surfing and snow skiing share similar maneuvers, but in surfing you have 
to paddle out to the waves and in skiing a lift takes you up the mountain. 

3. Time Order. This pattern shows a sequential relationship between ideas or events 
considered in the presence of the passage of time. 

Example. During the fall semester, John did the research for his dissertation. In the 
spring he completed writing his dissertation and was interviewed for a position in 
Australia that will begin this summer. 

4. Simple Listing. This pattem is characterized by a listing of items or ideas. The order 
of the items is not significant. 

Example. Margaret got everything she needed to paint the fence ~ a dropcloth, 
brushes, thinner, paint, and her hat, 

5. Problem/Solution. Similar to the cause/effect pattem, this pattem is exemplified by 
an interaction between at least two factors, one citing a problem and another provid- 
ing a potential answer to that pioblem. 

Example. Failing to remember things is a problem that plagues most of us. Fonu- 
nately, a simple solution involves making a list of items thai would otherwise slip 
from our memories. 
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6. Argument, This pattern unveils pro and con argunjcnts concerning a topic, ultimately 
supporting some favored view. 

Example. Skateboards should be banned on college campuses. While they provide 
low cost transportation for students between classes, they are responsible for an in- 
creasing number of accidents. 

Over ten years of research results have indicated that making students familiar with these six 
expository text structures enhances comprehension (Bean, 1988; McGee & Richgels, 1986; 
Richgels, McGee, Lomax, & Sheard. 1987). The research has shown that some text patterns 
make it easier for students to remember text information than others. For example, text presented 
in the pro and con pattern of an argument is remembered more easily than text that simply pres- 
ents infomiation in linear lists. 

Expository texts often include signal words that students can use to identify which text structure 
is being used. For example; 

• Cause/effect patterns often contain signal words like because, since, therefore, 
consequently, and as a result. 

• Comparison/contrast patterns use signal words like ho^^^c *fer, but, as well as, on 
the other hand, and similarly. 

• Time order patterns may use not long itfter, now, after, and before. 

Simple listing typically uses words like to begin with, first, second, next, and 
finally. 

Research by Meyer, Brandt, and Bluth (1980) showeu .uui ninth grade students who were taught 
to use these signal words to identify text structures were able to increase theh" recall of important 
information. 

During the noraial flow of instruction, teachers can observe students who are or are not using text 
structural cuec to aid their comprehension. Three indicators are listed below that can be used to 
check if students are usuig an author's text structure to their advantage (Bean, 1988). 

1 . When students are retelling a story or discussing an expository selection, do they 
seem to use the author's organizational structure as their retelling or comments 
unfold? 

2. When students are writing summaries or essays based on text reading, are there 
indications they are using text structure knowledge as a framework for developing 
their writing? 

3. As you observe students taking notes, outlining, mapping or graphically depicting 
text ideas, is there a pattern that shows they are using text structure cues to leam 
the concepts in a text? 
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Integrating Instruction and Assessment with 

Multimedia Responses to Literature 



In order to ensure that students will interact with the content of assigned reading material, many 
teachers have students give a book report after reading. 

The enclosed list presents some alternative assignments that teachers can use instead of book reports. 
Teachers can use the multimedia creations children produce to analyze and assess the children's 
degree of understanding of the main ideas and details in the selections read. By allowing children to 
demonstrate their learning in a variety of ways, teachers can allow children to demonstrate their 
areas of strength or areas of special talent which may include drawing for some children, drama for 
others, or construction of materials for still others. By presenting children with some choices regard- 
ing how to best represent what they learned, teachers can also help children become more self 
reliant, independent learners. It also empowers students to take more responsibility for the way in 
which they demonstrate what they have learned. 

Students can also be involved in the assessment of these creative demonstrations. Children can 
assess their own work as well as do critiques noting the strengths and also any confusing aspects in 
the work of their peers. 
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Multimedia Kespwses to Utermure 



How Do I Report Thee? Let Me Count The Ways 

(Suggestions for innovative ways of giving a book report.) 



Ftesent an oral summary of the book 
Read an exciting part aloud to the class 



Hold a Toundtable discussion of the book 



Give a chalkboard/felt board talk 



Listen to recordings related to the story 



Imer\icw an author 




Write a sumiiiar>' of the book 

Create a lost or found ad for a person in the story 

Compare this book with another you have read 

Write about a character in the stor>' you especially liked 

Pleparc a glossary of words and their defuiitions from the book 

investigate the life of the illustrator 

Write a 7-day journal a character in the story might have kept 

List five questions you would ask the author in an interview 

Write a newspaper article about the plot 

List topics the author probably had to research to write the story 

Administer a true/false quiz 



Research the life of the author 



Create a poem based on the story 
Create a new ending 
Add an epilogue 
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Mutlimdia Responses to Literature Page 2 

How Do I Report Thee? Let Me Count The Ways (Com.) 
(Suggestions for innovative ways of giving a book report.) 

Prepare a dramatization of the story 
Invent a product based on the story 
Create a board game based on the plot 
Dress as one of the characters in the book 
Design a video game based on the story 
Pantomime an imponant scene 
Demonstrate a scientific principle from the book 
Create a crossword puzzle based on elements in the book 
Do a mock TV news broadcast based on an event in the stor>' 
Gather a collection or objects described in the story 
Design a diorama of the s!or>' using an unusual background 
Paint a mural of pans of the sior>' 
Create puppets based on characters in the book 
Design a book jacket with an inside review of the stor>' 
Build a scale model of an imponant object in the book 
Draw a clock to indicate when an imponant event took place 
Design a 3-D scene 

Paint a watercolor scene based on the story 
Paint a poster to advertise the book 
Fingcrpaini an exciting scene 
Construct a mobile that reflects the plot 
Draw comic strip frames of the story's plot 
Create a collage about an imponant character 
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Mubimedia Respofu^ to Utenture 



How Do I Report Thee? Let Me Count The Ways 

(Suggestions for innovative ways of giving a book report.) 

Present an oral summary of the book 

Read an exciting part aloud to the class 

Hold a roundtable discussion of the book 

Give a chalkboard/felt board talk 

Listen to recordings related to the story 

Interview an author 

Write a summary of the book 

Create a lost or found ad for a person in the story 

Compare this book with another you have read 

Write about a character in the story you especially liked 

Prepare a glossary of words and their definitions from the book 

Investigate the life of the illustrator 

Write a 7-day journal a character in the story might have kept 

List five questions you would ask the author in an interview 

Write a newspaper article about the plot 

List topics the author probably had to research to write the story 

Administer a true/false quiz 

Research the life of the author 

Create a poem based on the story 

Create a new ending 

Add an epilogue 
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Multimedia Responds to Literature Page 2 

How Do I Report Thee? Let Me Count The Ways (Cont.) 
(Suggestions for innovative ways of giving a book report.) 

Prepare a dramatization of the story 

Invent a product based on the story 

Create a board game based on the plot 

Dress as one of the characters in the book 

Design a video game based on the story 

Pantomime an important scene 

Demonstrate a scientific principle from the book 

Create a crossword puzzle based on elements in the book 
Do a mock TV news broadcast based on an event in the story 
Gather a collection or objects described in the story 
Design a diorama of the story using an unusual background 
Paint a mural of pans of the story 
Create puppets based on characters in the book 
Design a book jacket with an inside review of the story 
Build a scale model of an important objeci i the book 
Draw a clock to indicate when an important event took place 
Design a 3-D scene 

Paint a watercolor scene based on the story 
Paint a poster to advertise the book 
Fingerpaint an exciting scene 
Construct a mobile that reflects the plot 
Draw comic strip frames of the story's plot 
Create a collage about an important character 
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Integrating Instruction and Assessment with 

Teacher (and Student) Questions 



Questions can be used by students and teachers for both instructional and diagnostic purposes. 
Teacher questions are probably one of the mosi common ways teachers elicit diagnostic infonnation 
about how much and bow well students axe understanding text Following free recall, open-ended 
questions are often used by teachers to help students retrieve additional infonxsation. By modeling 
how to detCTodne and construct questions based on text, teachers can also use questions instruction- 
ally to make the processes expm readers use when reading more explicit to their students. Strate- 
gies such as ReQuest, Question- Answer Relationships (QAR), Reciprocal Teaching, Think Alouds, 
SQ3R, etc. are i»sed on the ability to ask as well as answer nseaningfiil questions. To teach ques- 
tioning skills to indents, teachers usually begin with modeling followed by explicit instruction, 
guided practice, and coaching. We tell students what it is important to know 1^ what we ask them to 
recall, so if we want to develop advanced as well as basic skills, it is important that we ask open- 
ended and higher order questions. Below are examples of the kinds of questions either teachers or 
students can ask to elicit a range of skill levels. 



Sample Questions Which Help to Develop Comprehension 

I. Memory- recognizing or recalling information as given in the passage 

a. facts - 

Who did 7 How many ? 

When did ? What is/are ? 

b. defuMons •- terms used, and perhaps explained, in the text 

What is meant by ? 

What does mean? 

What meaning did you understand for 
Define 



Explain what we mean by 



7 



? 
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Teacher (and Student) QuestUtns Page 2 

1. Memory-- (cont.) 

c. generaUzatiotts - recognizing conunon characteristic of a group of ideas or 
things 



What events led to 



In what three ways do resemble ? 

Howdid ^and, affect ? 

d. values - a judgen^nt of quality 

What is said about , ? Do you agree? 



What kind of a pCTSon was , 



What did do that you wouldn't? 

2. TranslttHom - expressing ideas in different form or language 

Tell me in your own words how , . 



What kind of a drawing could you make to illustrate 
How could we restate 



Could we make up a play to tell this story? How? 

What does the writer mean by the phrase 

Write a story pretending you arc . 



3. Interpretation - trying to see relationships among facts, generalizations, values, etc. 
(there are several types of interpretation) 

a. Comparative - ideas that are the same, different, related, or opposed 

How is like ' 



Is the same as ? Why not? 

Which three are most alike in ? 

Compare with in . 
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Te acher (and Student) Qutsdons Page 3 

3. Interpretation ~ (cont) 

b. Implications - arriving at an idea which depends upon evidence in the reading 
passage 

What will and lead to? 

What justification for does the author give? 

If continues to , what is likely to happen? 

What would happen if ? 



c. Inductive thinking -- applying a generalization to a group of observed facts 

What facts in the story tend to support the idea that 

What is the author trying to tell you by 



What does the behavior of tell you about hinVher? 

What events led to ? Why? 

d. Quantitative - using a number of facts to reach a conclusion 

How much has increased? 

What conclusions can you draw from the table (graph) on page ? 

How many times did do ? Then what happened? 

How many causes of can you list? 

e. Cause and Effect - recognizing the events leading to a happening 

Why did (a character) ? 

How did (a character) make happen? 

What two things led up to ? 

When (a character) , what had to happen? 

Why did happen? 
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Teacher (and Studetu) QucsHons Page 4 

4. AppUcaHott -- solving a problem that requires the use of generalizations, facts, values, 
and other appropriate types of thinking 

Arc there street crossings that are dangerous on your way to school? What can we do to 
make them safer? 

If we want to raise hamsters in our classioom, what sort of plans will we have to make? 

John has been ill for several days. What cculd we do to help him during his illness? To 
show him we are thinking of him? 



5. Analysis - recognizing and applying rules of logic to the solution of a problem; analyzing an 
example of reasoning 

If someone told you, "All are kind and friendly," what would you say? 

Can you think of someone who would disagree? What might that person say? Why? 

Yolanda was once bitten by a dog. Now Yolanda dislikes all dogs. Is she right or wrong in 
her feelings? Why? 



6. Synthesis ~ using original, creative thinking to solve a problem 
What other titles could you think of for the story? 

What other ending can you think of for the story? 

If (a character) had not CacDflOl' what might have happened? 

Pretend you are a manufacturer of who wishes to produce a much better 

. Tell what you might do. 

7. Evaluation - making judgments based on clearly defined standards 

Did you enjoy the story of . ? For what reasons? 

What do you think of in this story? Do you approve of his/her actions? 

In the textbook, the author tells us that _feli . 

Is this a fact or the author's opinion? How do you know? 

This stoiy has a very happy ending. Should all stories end happily? Why or why not? 
[Questions adapted from: Sanders, N.M. (1966). Classroom questions: What kinds? New York: Harper and Row.J 
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Integrating Instruction and Assessment with 

Semantic Maps & Story Schema 



Semantic maps are diagnuns which help students see how words are related to each other. The 
procedure activater md builds on student's prior knowledge and generally involves brainstorming 
and discussion of ho new information links to this prior knowledge. The maps can be used for 
vocabulary and comprehension development as a preieading or postreading activity. They can also 
be used as a means of monitcmng or assessing student understanding of stcHy elements, use of prior 
knowledge, metacognitive skills, etc. 

Semantic mapping is not a new instructional strategy; for a number of years it was known as "se- 
mantic webbing," "plot mapping," or "semantic networking." Semantic webs are also often referred 
to as "spider maps" because they are formed with a central circle from which extend branches resem- 
bling the legs of a spider. There is an early reference to semantic mapping in a 1971 Journal of 
Reading article by M. B. Hanf entitled "Mapping; A Technique for Translating Reading Into Think- 
ing." Dale Johnson and P. David Pearson described and discussed semantic mapping in their 1978 
books Teaching Reading Vocabulary (updated in 1984) and Teaching Reading Comprehension. A 
number of research studies have validated the effectiveness of semantic mapping, contributing to the 
increased support of this as an effective instructional strategy. 

In March of 1991, the International Reading Association (IRA) published Responses to Uterature: 
Grades K-8 (Macon, Bcwell, & Vogt). This resource packet includes a number of "engagement 
activities" for before, during, and after reading that "utilize prior experience, integrate all the lan- 
guage processes, and assist students in learning and using useful strategies for active comprehension 
of text" (p. 2). The engagement activities arc interactive lessons built around schema. A schematic 
is a diagram or structure (such as a semantic map). Samples of the following schema from Re- 
sponses to Literature are included at the end of this handout: character map, story map, and story 
pyramid. 



How It Works 

While there arc a number of variations to semantic mapping, the general steps involved are: 

1 . Write the chosen vocabulary word or story topic on the blackboard. Draw a box or 
circle around that word/term. 

2. Encourage students to think of as many words or ideas as they can that relate to the 
selected word or topic. 

3. Students may: 

• write their ideas on paper and then share those ideas in group discussion; 

• brainstorm ideas in a small group to share in large group discussion; or 

• orally share ideas together to generate a class semantic map. 
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Semantic Mops & Story Sctxma 
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How It Works (cont.) 



4. Students' ideas are listed on the semantic map in categories which organize the 
words in a reasonable and related manner. These details or related wordsAideas are 
written around the main word/topic. 

5. Discussbn of the semantic xx^ap is peihaps the most important part of the activity. 
Here students see how wordsAdeas are related^ learn new wonis and find new mean- 
ings for wcHds they already know. During discussion, the teacher will focus on the 
ideas most appropriate to the lesson being taught, add new related ideas to the map, 
and help students to identify those ideas which do not appropriately fit the map. It is 
important that students have the opportunuity to discuss their reasons for their selec- 
tions in order to develop their metacognitive skills, help the teacher identify individ- 
ual needs, and discovo- viable rationales for otherwise apparently "wrong" selections. 

6. Analyze information from the discussion and the map to help determine subsequent 
instructional needs for both individuals and the group as part of the ongoing Integra- 
tion of instruction and assessment. 

Variadons on the basic steps listed above include the following: 

• With young children, substinjte a picmre for the central word. A Chapter 1 reading 
resource teacher in Maryland uses a picture variation, i.e., she has a picture of a wasp 
in the center of the map and, as children identify the parts of the wasp (wings, eyes, 
etc.), she writes the word, and each child draws a line fium his or her word to the 
appropriate body part 

• Use post-its on butcher block paper. Once the central word has been chosen (by the 
teachers or students), each student can write individual related words on separate 
post-its. The individual post-its can be grouped and regrouped to show different 
kinds of relationships and to reinforce the idea that there may be more than one right 
answer/way of looking at something. 



Using Semantic Maps Before Reading 

The following activity integrates information from several sources to build smdents' background 
knowledge for a topic to be studied. The teacher prepares for this activity by choosing several mate- 
rial.*; which provide information on the topic. These materials could include posters, pictures, maps, 
trade books, filmstrips, various high-interest/Iow-vocabulary reading materials, and textbook or 
basal materials. 

• The teacher writes the topic on the blackboard, draws a circle around the word, and 
tells students this topic will be studied. The teacher lists key vocabulary words on the 
blackboard, including a context phrase or sentence for each word. 
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Smantic Maps & Story Schema 

Using Semantic Maps Before Reading (com.) 



• Each key word is written on the semantic map (by teacher or a student) as a category 
heading. Each word is discussed, and details students already know about these 
category headings are listed in red chalk. 

Students are adced to skim the l»sal textbook to find the key words in context. 
Uses/meanings of those words in the text are discussed, and those ideas are written on 
the semantic map in white chalk. (The different colored chalk indicates inforoaation 
from different sources.) 

Students review the other materials (e.g., posters, fihnstrips, library books) to find 
additional information which fits or relates to the categories on the senaantic map. 
These ideas are written on the map in blue chalk. 

• Students read the textbook material, stopping at the end of each section to add infor- 
mation to the semantic map. This information is written in white chalk to indicate 
that the information came from the textbook. When the semantic map is completed, 
the teacher uses the map to help the students summarize or recap the information 
about the topic. 

• The information from different sources is then compared and discussed using 

the color codes (red came from prior knowledge, white from the textbook, and blue 
from additional sources). Emphasis should be given to how the use of multiple 
sources increased knowledge, changed underetanding, and/or created more questions. 

Using Semantic Maps After Reading 

This activity involves students making predictions about a story based on prior knowledge, reading, 
developing a concept map. and then rereading the story for any missing information. 

• Students are told that they are going to read a story abou* "(topic)". The teacher 
provides or elicits enough context for tiie upcoming reading to help students make 
predictions about what they think will happen in the story. Key vocabulary words 
are introduced in context, and then students read the story silentiy. 

• The tide of the stoiy is written in the center of the blackboard and a circle is drawn 
around it. On lines drawn from the circle, key concepts or themes from the story are 
written. For example, these concepts/themes might be how the characters look, 
important problems and episodes in the story, how the characters feel or react, and 
outcomes of the story. Students suggest ideas for each of Uiese concepts/themes 
based on what they remember from reading the story. Their ideas are written on the 
map. 
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Using Semantic Maps After Reading (cont.) 



• The teacher and students lecap the story by reviewing the semantic map. Students 
then reread the story (orally or silently) to look for other important information that 
was not included on the map. As students find new information through this guided 
reading, it is added to the map. This step is a form of self-assessment and self- 
correction that is empowering as long as there is critical information missing from the 
initial version of the map. It is self-defeating to have students complete this step 
looking for unimportant details. 

• Students use the completed map to guide retelling of the story. If appropriate, sm- 
dents might role-play or act out the story. The map can also be used to structure a 
writing activity in which students write about the story using the information on 
the map. 

Sample Semantic Map 



An example of a semantic map for Bill Martin Jr. and John Archambault's Knots on a Counting 
Rope (1987) is shown below. Although the elements and supporting details in the map can be used 
to cue retelling of this story, the categories are a blend of characters, events, and themes that do not 
appear strictiy in chronological ordei. The logic of this kind of semantic map is sometimes apparent 
only to the student(s) who develoi^ it A good follow-up activity is to have the student(s) explain 
how the categories and details were selected and what they mean. 
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Semantic Maps & Story Schema 

Sample Story Map 



A story map is used to identify story elements in simple stories. It is laid out in a linear format and 
fits the chronological order in which story elements are introduced in most simple stories. This 
schematic is not suited for complex stories with several plot lines or atypic^ structures. It answers 
the question "What was the story about?" in a more straight forward manner than schema such as 
spider maps. The story map also worics best to cue retelling if the purpose is to recount the basic 
story elements in a logical order. Although all the elements are thoie, this schematic does the least to 
capture the flavor of a story. However* for many students it is a helpful preliminary to further dis- 
cussion and analysis. The sample story map below is based on Knots on a Counting Rope (Martin & 
Archambault, 1987). 



The setting/main characters i4f o campfire, ihe grandfather fells the boy the story 

of the boy's life. 

Grandfather and Boy-Strength-of- Blue-Horses 



Problem in the story The boy was born blind, and the grandfather won't always 

be there to tell the story. 



Event 1 'The boy Is born sick and weak, and everyone is afraid 
he will die. 



Event 2 The blue horses appear and give the boy strength, so he's 
named Boy-Strength-of -Blue-Horses, 



Event 3 /I foal is born that the boy calls (Rainbow. She becomes his 
eyes, taking him to the sheep and home again. 



Event 4 The boy rides Rainbow like the wind In a race though he's 
afraid at first. He doesn't win, but he is successful. 



Events Grandfather ties a knot on his counting rope when he fin- 
ishes the story and tells the boy he will be able to tell his 
ovfn story when the rope is full of knots. 



Resolution of the problem Boy learns to "cross dark mountains" and 'see" through 

feeling, remembering, and hearing. When his grand- 
father is gone, he will be able to tell his own story. 



Story theme (What is the story really about?) Although dark mountains are always 

there and make you afraid, you can learn 
to cross them. It's Important to know 
who you are and have faith in yourself. 
At first, that faith needs encouragement 
from others in order to grow. 
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Story Map Frame 



The setting/main characters 



Problem in the story 



Event 1 



Event 2 



Event 3 



Event 4 



Event 5 



Resolution of the problem 



Story theme (What is the story really about?) 



[Adapted from: Macon, J. M.. Bewell, & Vogt, M. (1991). Responses to literature- Grades K-8 (pp. 9-10). 
Newaik. DE: Intemaitonal Reading Asociation.] 
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Semantic Maps & Story Schema 

Sample Character Map 
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Character maps are schema that are best completed after reading a story. Students write the name of 
a character or paste his or ha picture in the box in the center of the page. Around the central box, 
and connected to it* they draw ovals in which they place character traits. In circles connected to the 
respective trait ovals, they write action from the story that support those traits. Students can com- 
plete character charts independently or in cooperative learning groups. 

In order to complete a character map, stiKients have to infer character traits which are often not 
explicitly stated in the story. Rereading parts of the stoiy is often necessary. Sometimes students 
need to list actions of the character as a preliminary step jid/or list a number of character traits 
before they can see which traits match which actions. On the map below, two opposite traits are 
listed on opposing arms of the horizontal axis. This kind of schematic is particularly appropriate for 
showing that a complex character can have seemingly opposite characteristics. like a QAD (Ques- 
tion-Answer Detail) chart, the schematic requires students to find supporting detail for their conclu- 
sions. Character charts can be completed for more than one character, but when the purpose is to 
compare and contrast characters, a Venn Diagram (Macon el aL, 1991, pp. 21-22) is more appropri- 
ate. The character map below is based on Knots on a Counting Rope (Martin & Archambault, 1987). 
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Semantic Maps <£ Story ScAewa 

Character Map Frame 




lAdapted from: Macon. J. M.. Bewell, D., & Vogt, M. (1991). Responses to literature: Grades K-8 (pp. 9-\0). 
Newaiic, DE; Iniemalional Reading Asociaiion J 
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Semantic Maps <t Story Schma 



Sample Stoiy Pyramid 

Pyramids axe particularly popular with upper elementaiy and middle school students; they can be 
used as a teacher directed group activity with younger children. The stoiy pyramid schematic below 
is based on Knots on a Coundng Rope (Maitin & Archambault, 1987). llie pyramid structure forces 
students to really consider their word selections carefully. Obviously, students will come up with 
different choices. Clarification of individual "shorthand** and discussion of the range of choices and 
rationales provide enriching extensions to the activity. For example, the wends chosen to describe 
the main character on line two of the pyramid below seem to be contradictory. On line three, "south- 
west" has been inferred primarily from the illustrations in the book. "Blue" on line three does not 
appear to be a very good choice until you are reminded that the grandfather helps the boy understand 
be can feel and hear nature around him in order to define bhie. 

1 of'Btue-Horses 



2 fez/ntf 



sees 



3 compftre 



southwest 



blue 



4. must 



cross 



dark 



mountains 



boy 



born 



weak / 



horses 



strength 



Rainttow 



takes 



boy 



to 



sheep X 



home 



7. Boy 



rides 



Rainbow 



like 



Wind 



in 



race 



8. 



Boy 



sees 



with 



heart 



and 



learns 



his 



story 



1. Name of main character 

2. Two words describing main character 

3. Three words describing setting 

4. Four words stating problem 

5. Five words describing one event 

6. Six words dcKsribing second event 

7. Seven words describing third event 

8. Eight words stating solution 



Student 



Knots o> <' C'J '^f'ng Rope 



Name of Book 



BUI Alartln Jr. S, John Archambautt 



Author 
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Story Pyramid Frame 



1. 



2. 



3. 



4. 



7. 



8. 



1. Name of main character 

2. Two words describing main character 

3. Three words describing setting 

4. Four words stating problem 

5. Five words describing one event 

6. Six words describing second event 

7. Seven words describing third event 

8. Eight words stating solution 



Student 



Name of Book 



Author 



{Adapted from: Macon, J. M., Bewell D., & Vogl. M. (1991). Responses to literature: Grades K-B (pp. 23-24). 
Newark, DE: Iniemaiional Reading Asociation.] 
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Graphic outlines/semantic maps/schemata are tools to organize information in order to better see pat- 
terns and relationships among wmds« concepts, stoiy elements, etc. They come in a variety of fonms, 
some of which have already been noted. Not cvay form fits every kind of reading or type of infor- 
mation. Unless the form fits the structure of the information, its use hinders rather than enhances 
understanding. As noted in Strategic Teaching and Learning: Cognitive Instruction in the Content 
Areas^ "... a spider map is nu>st appropriate to describe one thing, such as an object with its attributes 
and features, a theme with supporting infomaation^ a concept with critical features and examples, or a 
problem with various solutions or consequences... this structure is less useful when describing a 
sequence of events or a concept hierarchy*" (Jones, Palincsar, Ogle, & Carr, 1987, p. 38). 

Aside from the question of choosing ^e appropriate form, teachers need to realize that using 
graphic outlines generally "does not come easy" for students. It is often difficult for them to identify 
the organizational structure in reading material or develop a structure where one is not apparent 
Graphic outlines are most effective when their use is taught within the context of material for which 
a structural frame woric aids comprehension and when instruction includes the following (Jones et al., 
pp. 39-40): 

1. key structural elements such as the relevant categories of information, question, 
or concepts; 

2. the appropriate graphic structure(s); 

3. where relevant, ^propriate rules^}rocedures for summarization; 

4. explicit instruction in how to apply the frames, graphics, and summarizing procedures 
to a variety of learning situations; 

5. opportunities for the class to work as a whole or in small groups with an emphasis on 
brainstorming and cooperative learning; 

6. opportunities for discrimination and transfer, and 

7. concerted effort to link the new infomiation to prior knowledge. 

Pick a story and work through these semantic maps and story schema yourself. You wiU see that use 
of these graphic frames forces you to grapple with the story and come to a deeper understanding of 
it. You will also gain a better understanding of the hard work invoh ed in applying these frames and 
recognize the importance of choosing stories Aat are worth the effon. The completed frames are 
also "artifacts" tiiat provide a record not only of what books students have read, but of how deeply 
they understood those books. 
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Integrating Instruction and Assessment with 

Question-Answer Relationships 



Unlike good readers, at-risk readers tend not to anticipate teacher questions and also don't seem to 
understand how questions are related to the information found in the text (Hdfeldt & Henk, 1990). 

Question-Answer Relationships (QAR) draw students* attention to the need to consider not only text- 
based, but also reader-based infonnation when answering certain types of questions. 

QAR instruction begins by having pupils classify comprehension questions according to how they 
can be answered. Through teacher modeling and guided practice, teachers show that the type of 
question detennines what kinds of thought processes and strategies must be used to answer it. Stu- 
dents learn the various types of infonnation available to them both in the text and in their back- 
ground experience and they leam when and how to use them. 

How It Works 



The QAR strategy helps students clarify the different sources of information available to answer 
questions. It can be used as pan of the ReQuest Procedure (see Handout H17) and/or in conjunction 
with the Question-Answer Detail (QAD) Chart (sec Handout H24). The teacher helps the students 
decide if the questions they asked can be answered from information IN-THE-BOOK or IN-M Y- 
HEAD (Raphael. 1982. 1985). 

The IN-THE-BOOK category includes: 

1 . answers that are stated in the text (RIGHT THERE) or 

2. answers that require the reader to put together material from the text spread across 
several different sentences and draw a conclusion. (THINK AND SEARCH). 

The IN-MY-HEAD category includes answers that require: 

1 . students to think about what they already know and how that information fits in with 
the information the author provides in the text (AUTHOR AND ME) or 

2. questions that can be answered without reading the text, directly from prior knowl- 
edge (ON MY OWN). 

(}uestion-A^^ 

In the Book In My Head 




Right There Think & Search Author and Me On My Own 

C & I Specialty Option I PRC. Inc. 1 260 J Fortune Circle East, Suite 300A I Indianapolis. IN 4624 J I (800) 456-2380 H23 
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Some variations on the QAR procedure include: 

• The student reads a passage and develops a series of questions about the passage. 
After learning to construct higher-level questions, the student will foimulate questions 
based on specific guidelines. 

« The student reads a passage. The teacher constructs questions fiom the passage based 
on the four types of question-answer relationships. As the student answers these questions, 
the teacher assesses how well the student handles different types of questions. 
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Integrating Instruction and Assessment with 

Question- Answer Detail Charts 



Getting meaning fiiom teit is a complex process that involves the interaction of reader, context, and 
text. Too often, students treat the text as if it were a series of isolated facts of equal importance, all 
of which have to be learned. This viewpoint makes understanding and remembering what has been 
read an almost impossible task. The Question- Answer Detail (QAD) Chan is a schematic which can 
be used to help students (1) understand the relationship between main ideas and supporting details in 
text and (2) organize the infomiation in wder to improve retention and recall. The QAD chart has 
three columns. Questions based on the text are placed in the first column; answers and supporting 
details are placed in columns two and three. The questions are developed by the snidents and may 
be based on prior knowledge, background information, skimming the text, or some other process. 
However, this schematic is designed to help students understand and organize the information that is 
in the text, so the answers and supporting details must come from the text itself. 

A Question-Answer Detail Chart can be used for both instructional and assessment purposes. In 
assessing student responses, the teacher checks that: 

• answers and details demonstrate adequate comprehension of the reading passage, 

• answers and details demonstrate adequate retention of the information in the passage, 

• answers are based on passage U^ormatwn rather than the reader's prior knowledge, and 

• details/reasons adequately support the answer given and show an understanding of 
the relationships (1) between main ideas and supporting details and (2) among 
supporting details. 

Based on his or her analysis, the teacher plans subs^uent instruction, i. e., students might need help 
developing appropriate questions, using mnemonic aids or other strategies to help them retain and 
recall information, etc. QAD charts can also be used by students for self-evaluarion. Students can 
use the QAD charts for self-checks and self-quizzes. TTie answer-with-supporting- detail pattern is 
often used in teacher-made and standardized tests. Many students lose points on essay exams for 
failing to provide sufficient supporting detail. The QAD chan schematic can be used to help stu- 
dents plan and write better essays. 

How It Works 
The basic steps: 

1. Students divide their papers into three columns. They put "Question" at the 
top of the first column, "Answer" at the top of the second column, and "Detail" 
at the top of the third column. 
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How It Works (cont.) 



2. Students write questions about important points in the stoiy or text in the 

first column- questions are based on prior knowledge, background inframation, 
skimming, etc. 

3. Students read the selection and write the answers and supporting details for each 
question without referring back to the story f text. 

4. U necessary, probing questions, prompts, or ro^dmgs are used to fill in gaps. 

5. Subsequent instruction is planned based on student and/or teacher analysis of 
student responses. 

Variations on the basic steps: 

• teacher models whole process 

• teacher and class woik through the whole process together 

• teacher develops questions for students 

• students develop questions for each other 

A key to the effectiveness of this strategy is that the questions are not trivial. For that reason, teach- 
ers need to provide initial modeling, guided practice, and coaching. At first, the teacher may need to 
use probing questions to help students recall more details or teach them a repenoire of prompts they 
can ask themselves if they get stumped (ie., "Why did that happen?" "What does that mean?" "What 
is an example?" ). After students have recalled all they can, they may need to recheck passages in 
the text to fill in any remaining gaps or to verify their responses. Students should not fill in the chan 
as they read, since that would make it harder to comprehend the selection as a whole. 

Sample QAD Chart 



QUESTION 


ANSWER 


DETAIL 


I. Who fought in 
the Civil War? 


The Norfb against 
the South 


norfh^Confederacy, Pres. 

Jefierson Davis 
soaff)' Union, Pres. Abraham 

Uf)Coln 


2. Who commanded 
Southern troops? 


General Robert £. 
Lee 


graduated West Point 
asked to lead the North 
home across river from 
Washlr^gfon, £).C. 


3. Who commanded 
Northern troops? 


Several generals, 
U. S. Grant last 
&. most successful 


forced Lee's surrender 

at Appomattox 
became President 



Adapted firom; Cagncy.M.A. (1988). Measut^ig comprehension: Alternative diagnostic approaches. In S. M. Glazer. 
L. W. Searfoss, & L, M. Gentile (Eds.), Reexamining reading diagnosis: New trends and procedures (p. 90). Newaiit, 
DE: Iniemaiion^d Reading Association. 
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CHAPTER 1 READING PROGRAM 
ASSESSMENT" Two Steps 



To improve your reading program, it is helpful to review your present program in light of current 
research. In <»^er to complete such a review, guidelines for a two-step process are provided in this 
handout It is important to complete the first step either independently or in snail discussion groups 
before proceeding to the second step. 

STEP ONE: What Should We Be Doing? 

In the left-hand column of the chart below, statements derived from research are listed. These state- 
ments represent specific findings from a variety of research studies which explored the process of 
reading, reading instrjction, and reading habits. As with all research, these findings suggest implica- 
tions for classroom instruction and shident evaluation. Read each statement Then think about or 
discuss possible implications of the statement In other words, think about or discuss what the 
statcraen' suggests for reading instruction and evaluation. 



ifCeading Process 

What does the lesearch say? what does this suggest . . . 

for instruction? for student evaluation? 

1 . Setting a puipose for reading 

aids comprehension. 



2. Prior knowledge is a critical 
determining factor in 
reading comprehension. 



3. Good readers use a variety of 
strategies to attain meaning and 
adjust their strategies to the 
demands of the text 
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Reading Process (cont) 

What does the research say? What does this suggest . . . 

for instruction? for student evaluation? 

4. Knowledge of text structure 

aids reading comprehension. ^ 



5. EfBcient readers continuoudy 
naonitor their understanding of 
text and use "repair" strategies 
when comprehension breaks 
down. 

6. Good readers define a good 
reader as one who reads for 
understanding; poor readers 
define a good reader as 
one who reads well orally. 



7. Using predicting strategies is 
an integral part of the reading 
process. 



8. Comprehension is interrupted 
if a reader continuously stops to 
sound out unknown words. 



Reading Instruction 

9. The 1985 National Assessment 

of Educational Progress reponed 

that while nearly all students 

have basic reading skills, many 

lack higher level reading skills. 
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Reading Instruction (cont.) 

What does the research say? What does this suggest . . . 

for instruction? for student evaluation? 



10. Poor readers receive instruc- 
tion that is qualitatively 
different- lower quality 
reading materials^ more woik- 
sheets, few whole texts. 



11. Poor readers are allowed too 
little time for silent reading. 
The emphasis on oral reading 
results in less reading. 



12. Teaching reading as a set of 
discrete skills isolated from 
each other and from the read- 
ing process impedes compre- 
hension. 



13. Teaching vocabulary contex- 
tually is a key component of 
effective reading instruction. 



14. Modeling is an effective 
teaching strategy. 



15. There is a direct correlation 
between reading achievement 
and self-concept. 
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Reading Process (cont) 

Wha; does the research sa>? What does this suggest . . . 

for instruction? for student evaluation? 



16. Interruptions of good refers 
relate to meaning, while those 
of poor readers relate to decod- 
ing skills. 



17. Good readers are interrupted 
one out of five errors while 
poor readers are interrupted 
four out of five errors. 



18. Interactive comprehension 
instruction aids learning. 



Reading Habits 



19. People in our society read a 
greater variety of texts than 
ever before. 



J'O. There are much greater voca- 

tional and cultural demands for 
people in our society to be able 

to read critically and evalua- ' • 

tively. — ■ ' 

Go On To Step Two 
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STEP TWO: What Are We Doing? 

In step one, you reflected upon current research findings in reading and their implications for in- 
struction and evaluation. In step two, you will describe the status of your Chapter 1 reading prqject 
by scoring each stateD?cnt on the scale of T' (not at all like our program) to "5" (very much like our 
program.) If you have no knowledge of an item» put an X ♦hrough the item number at the left. After 
completing the rating, circle the number in front of the five itons you feel should receive special 
attention in improving the program for Chapter 1 students. 



PROGRAM GOALS/DESIRED OUTCOMES 












1. Carefully stated goals/desired outcomes have 
been developed for the Chapter 1 reading 
program. 


1 


2 


3 


4 


5 


CURRICULUM 












2. Chapter 1 uses the district/classroom curriculum 
as a guide to providing reading instruction. 


1 


2 


3 


4 


5 


3. Chapter 1 and regular classroom staff have worked 
together to design a reading curriculum that is 
based on current research. 


1 


2 


3 


4 


5 


4. The main goal of the reading curriculum is to 
teach reading comprehension and to teach word 
recognition skills within that context. 


1 


2 


3 


4 


5 


5. A variety of reading materials and real-life purposes 
for reading are included in the reading curriculum. 


1 


2 


3 


4 


5 


6. Interpretive and critical reading strategies are a 
regular part of the curriculum in Chapter 1 . 


1 


2 


3 


4 


5 
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INSTRUCTION 

7. Teachers teach that the goals of reading are to 
think and understand. 

8. Teachers teach students how to adjust their reading 
strategies when reading different types of materials. 

9. Teachers guide students to read for meaning rather 
than for word-by-word accuracy. 

10. Teachers guide students to cstablirfi their own 
purposes for reading, so they know why they are 
reading and what information they seek. 

1 1 . Teachers guide students to access their prior 
knowledg*? before, during, and after reading. 

12. Teachers provide students with additional in- 
formation bsfore reading when prior knowledge 
is insufficient for comprehension. 

1 3- Teachers teach a variety of strategies to construct 
meaning from <ex: - skimming, predicting, draw- 
ing inferences, using graphic clues, re-reading, 
paraphrasing, reading ahead to use the context. 

14. Teachers teach students to use text strucmre to 
make sense cf written material. 

1 5. Teachers guide students to monitor their own 
comprehension as they read. 

1 6. Teachers provide many opfwrtunities for students 
to read quality books, poems, stories, plays . . . 

in their entirely. 

17. Teachers interact with student often about their 
reading and encourage students to interact with 
each other. 

18. Teachers regularly give students the opportunity 
to read silently before asking them to read orally. 



2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 
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INSTRUCTION (cont) 

19. Oral reading is performed for a puipose that is 
meaningful to the student 

20. Teachers identify skill needs by the text, the pur- 
pose of the activity, and the student's abilities. 

21 . Teachers conduct skill instruction in the context 
of meaning. 

22. Teachers provide instruction that requires inte- 
gration of reading/thinking skills. 

23. Teachers provide instruction in vocabulary develop- 
ment that includes; pre-reading activities relating 
prior knowledge to material; during-reading strategies 
such as developing work concepts using context clues; 
post-reading activities such as di^ussion and writing. 

24. Teachers provide instruction in a variety of word 
recognition strategies inclr.ding context, phonics, 
predicting, using graphic clues. 

25. Teachers model and discuss reading strategies with 
the goal of helping students become self-sufficient 
readers. 

26- Teachers convey the value of reading through their 
own reading habits, by reading aloud to students, 
and by providing real-life situations for which 
reading is the solution. 

27. Teachers engage students in appropriate reading 
activities for their interest and skills to make sure 
they experience success. 

28. Teachers interrupt students for corrections related 
to contextual understanding rather than for 
discrete decoding skills. 

29. Teachers provide adequate time for students to 
process the meaning of text, to self-correct, and 
to answer questions. 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



1 
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INSTRUCTION (cont.) 



30. 


Teachers use specific approaches designed to encour- 
age active and naore in-depth involvement with read- 
ing material. Examples of such ^)pn>aches are: Re- 
Quest, Reciprocal Teaching, Think- Along, and KWL. 


1 


2 


3 


4 


5 


INSTRUCTIONAL MANAGEMENT 












31. 


There is sufficient time allocated for ChaptCT 1 
supplemental instruction to meet the goals of 
the program. 


1 


2 


3 


4 


5 


32. 


A variety of trade books and other reading material 
IS available for instruction. Supp(»rt matenals are 
also available. 


1 


2 


3 


4 


5 


33. 


Adequate time and resources are available for Chap- 
ter 1 teachers to coordinate instruction with regular 
classroom teachers. 


1 


2 


3 


4 


5 


34. 


Chapter 1 instruction supports the regular classroom 
by including reinforcement of classroom lessons and 
and readiness for classroom instruction. 


1 


2 


3 


4 


5 


35. 


Chapter 1 instructional staff knows what is being 
taught in the regular classroom on a day-To-day basis. 


1 


2 


3 


4 


5 


36. 


Classroom teachers know the approach and mate- 
rials that Chapter 1 is using with their students. 


1 


2 


3 


4 


5 


37. 


A variety of management strategies such as Cooper- 
ative Learning, Peer Tutoring, and Repeated Read- 
ing or other means of promoting active learning 
is a regular part of instruction. 


1 




3 


4 


5 


38. 


Independent seatwork practice on classroom or other 
worksheet activities makes up a small part of Chapter 
1 class time. 


1 


2 


3 


4 


5 
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STAFF TRAINING/EXPERTISE 



39. 


Chapter 1 and regular staff jointly participate in 
in-service training to improve their reading instruc- 
tional skills and to maintain current knowledge 
of applicable research. 


1 


2 


3 


4 


5 


40. 


Professional journals such as The Reading 
Teacher or the Journal of Reading are available 
and used to improve instruction. 


1 


2 


3 


4 


5 


PARENTAL INVOLVEMENT 












41. 


There is a systematic effort to train parents and 
encourage them to read with their students at home. 


1 


2 


3 


4 


5 


42. 


Parents can check out books, materials, games, 
videotapes, to use with their children at home. 


1 


2 


3 


4 


5 


EVALUATION 












43. 


Assessment methods are congruent with the 
current research on reading comprehension 
which includes the importance of prior know- 
ledge; the interaction of reader, text, and con- 
text; and the use of metacognidve strategies. 


1 


2 


3 


4 


5 


44. 


Standardized test information is supplemented 
with teacher constructed and administered 
measures. 


1 


2 


3 


4 


5 


45. 


Student assessments are based on reading tasks 
conducted with actual classroom materials. 


1 


2 


3 


4 


5 


46. 


Assessment is integrated with instmction. Infor- 
mation about student weaknesses are used as the 
basis for instructional decisions. 


1 


2 


3 


4 


5 


47. 


Assessments identify students' strengths and 
accomplishments. 


1 


2 


3 


4 


5 
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EVALUATION (cont.) 



48. 


Assessment practices incorporate and develop 
stuaeni metacognitive and seit -evaluation skuis. 


1 


2 


3 


4 


5 


50. 


Assessments measure process as well as products. 


1 


2 


3 


4 


5 


51. 


Students are measured on an ongoing and dynamic 
basis. 


1 


2 


3 


4 


5 


52. 


The assessment program includes multiple tools, 
environments, strategies, and texts. 


1 


2 


3 


4 


5 


OTHER 












53. 




1 


2 


3 


4 


5 


54. 




1 


2 


3 


4 


5 


55. 




1 


2 


3 


4 


5 


56. 




1 


2 


3 


4 


5 


57. 




i 

1 


z 


i 


A 

4 


c 

5 
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WORKSHOP EVALUATION FORM 



Workshop Topic: 
Ptesenten 



Date: 



Your Job Dcscription/Responsilrility (please check all that apply): Adnunistrator/COordinator 

Principal Chapter 1 Teacher ChaptCT 1 Aide ^Non-Chapter 1 Teacher 

Non-Chapter 1 Aide Parent Other (please specify): 



r 



Directions: Please circle the rating number that indicates the degree to which you agree with 
the following statements. 



1 . The goals of this woikshop were achieved. 

2. The presentation was clearly communicated. 

3. The activities wore appropriate for the topic(s). 

4. The overhead transparencies and/or other 
audio-visuals were effective. 

5. The handouts were appropriate and useful. 
6- The presenter was responsive to questions 

and comments. 
7. The presenter was knowledgeable about the 
topic. 



COMPLETELY 
DISAGREE 



1 
1 
1 
1 

1 
1 



2 
2 
2 
2 

2 
2 



3 
3 
3 
3 

3 
3 



COMPLETELY 
AGREE 



4 
4 
4 
4 

4 
4 



5 
5 
5 
5 

5 
5 



A. What were the most noteworthy aspects of the workshop? 



B. What changes would you suggest to improve the workshop? 



ERIC 



C. How can TAC/R-TAC, the SEA, or LEA assist you further? (check all that apply) 
I would like: follow-up workshop session(s) on 



an on-site consultation [topic(s)) 

a phone consultation 

other (please specify): 

Name: 

PositionH'itle: 
Address: 

Phone (please include area code): 

D. Please make additional comments or suggestions on the back. THANK VOUJ 
O C&! Specialty Option I PRC. Inc. 1 2601 Fortune Circle East, Suite 300A I Indianapolis, IN 46241 1 (800) 4S6-2m H26 
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Reading Assessment- 



A Selected Bibliography 



The entries in this bibliography reflect assessment practices congruent with the roost cunent 
research supported definitions of reading oon^rehension which onphasize the importance of prior 
knowledge; the interaction of reader, text, and context; and the use of metacognitive strategies. 
Together, the selections provide a solid rationale and knowledge base for conducting assessments 
that 

• are teacher constructed^nducted 

• are based on reading ta^ with actual classroom materials 

• are fully integrated with instruction 
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• incorporate and develqj student self-evaluation 

• measure process 

• are ongoing and dynamic 

• stress the use of multiple tools, environments, strategies, and texts 

The entries cover a range of inctnictional levels, jjwluding early childhood, elementaiy, secondary, 
and adult basic education. Please note that entiies focused on informai reading 
inventories, portfolio assessment, and assessment in whole language 
programs/classrooms have been listed separately after the initial section of 
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Bnzo mches reading education courses at Eastsm 
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by Charies MerrilL 



Learning how at-risk 
readers learn best: 
A case for interactive 

assessment 



William G. Brozo 



■ Attention. ^ are at»>ut io take a reading compre- 
hension test Read the passage below, then answer 
the questions that follow it. Tnis is a timed les,*. 

The Corrsci Intefpretation el ttus ThifTy-Fou^t^ Seciwi 

Thf ihifty-foufin seciion rafffs to th» eonsiruciion ttereof 
BdoptBd by th« local tnbun&is. »ni to rights of things having a 
permanant locality, and oihar maiters imfflovabta and mtrateirito- 
nai In msir nature and cnaractar. it navar has twen $uopMed that 
tha saction did apply, or was intandad to apply, to quasiions of a 
more ganarai natura. not at all dapandem upon a fixed and par* 
manant operation, as. for example, to the construction of wnttsn 
•nstruments. wtiere irte state tnbunais are c^ied upon to ^rform. 
that IS. to ascertain gpon generiil reasoning and legal analogies 
what IS the true exposition of the instrument. 

Ba^ upon this interpretation, it seems to us that it would be 
at least as reasonable to assume an intent that the pmver should 
be imperative as to properly known to be pr<xJuctive but which 
later becomes unproductive we thmk under the facts of this case 
the existence of an mtent thai the power of sate was to become 
imperati>« upon failure of producitvity with likelihood of continu- 
ance of that status, may be imputed to the testator. 

1. In the first paragraph, what is the best meaning tor 
"legal analogies?" 

2. What is the main idea of this passage? 

3. Has repartition been attributed to the successors? 

4. Write in your own words the meaning o/ the thirty- 
fourth section. 

5. In the second paragraph, what is the best meaning 
for "imputed to the testator?" 

Please put your pencils down, and pass your answer 
sheets forward. You will be notified within a few days 
whether you will need further testing and remedial 
work or be sent to the top wading group. Thank you. 

Few intetiigent adults would regard this as a fair as- 
sessment of their reading ability. Indeed, few of my 
students who are reading teachers have anything 
good to say about this test. Their protests usually cen- 
ter on abstruse vocabutary. timited context, and, 
above all, invalid use of the nasults. "Precisely," I re- 
join, "so why do we insist on testing our high-risk stu« 
dents in much the same way?" 

Imagine how frustrated you would feel if you actu- 
ally were placed into a reading group according to 
your performance on this single test? Does your fail- 
ure mean that you are a disabled reader? And if you 
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answer "no" to this fast question because you believe 
the ^ssage upon which I based my questions is im- 
possible to understand, how many times do our poor 
readers confront passages on reading tests thdt are 
equally unintelligible or removed from their experi- 
ence? What recourse do they have if we decide to 
base plMoment decisions on a test comprised o! such 
passages? Wbuld students' protests about the test be 
heard or understood? 

My reading test can be described &n a static mea- 
sure of reading comprehension. Traditional static as- 
sessment Involves the student reading and answering 
questions, and the teacher deriving performance lev- 
els with scoring keys and norming tables. It Is pre- 
sumed that the results provide an accurate reflection 
d one's current status as a reader. 

Conspicuously absent from this typical form of as- 
sessment are the insights gained from and offered by 
some of the best researchers and thinkers in our field 
today. Most would agree that reading is a process 
of constructing meaning through the interaction 
among the reader, the text, and the context of the 
renting situation. 

Given the current conception of the interactive na- 
tun9 of reading comprehension, it is becoming less 
and less meaningful to talk about readers in terms of 
"problems" or "pathologies." If this were not the 
case, then I would be perfectly correct in claiming that 
you have a reading prob'em based on your perform- 
ance on *'The Correct Interpretation of the Thirty- 
Fourth Section," I am certain you would not accept 
this characterization of your ability to read. 

It is far more meaningful, I believe, to talk about 
methods and strategies for improving a reader's prog- 
ress. This subt'e shifting of language away from terms 
like "disability" and "retardation" toward discussing 
ways of "improving the leariv.ng conditions for a stu- 
dent" helps reshape our perceptions of these readers 
just as the term "mobility impaired" invokes a more 
acceptable Image of a person than "crippled" or the 
more vulgar description, "gimp." 

Interactive assessment 

TWO separate but mutually supportive lines of inquiry 
have merged to inform current reading assessment 
practices. Feuerstein. Rand, and Hoffman (1979) and 
Vye, Bums. Delclos, and Brandsford {in press) using a 
model of dynamic assessment have demonstrated 
that intelligence of very low performers can be leav- 
ened with interactive techniques. The gains they doc- 
umented for mental! / retarded students have put into 
question notions that intelligence is static and immu- 
table. 



Today, reading researchers are mounting a serious 
effort to move reading assessment into line with our 
current conceptions of reading (Valencia & Pearson, 
1987; Wixson. Peters. Weber. & Roeber. 1987). Ac- 
cording to Wixson and Upson (1936). in order to align 
asseasmert with current reading theory and research, 
it must become more interactive. Indeed, Pearson and 
Valencia (1987) have urged that testing and teaching 
should be viewed as integrated and virtually indistin- 
guishable events. 

A view of reading as an interaction suggests that a 
student's performance on various measures of com- 
prehension car. be expected to vary as a function of 
the conditions under which he/she is being evaluated. 
This means that a student's ability to comprehei d Is 
not fixed or constant; rather, comprehension will vary 
across texts, tasks, and settings (prior knowledge and 
interest are two powerful factors that contribute to vari- 
ability on reading tasks). If this idea is difficult to un- 
derstand. consider how impossible it was for you to 
comprehend my reading test passage, yet think how 
easy it is to understand a book, article, or essay on 
your favorite topic. 

If reading ability were fixed or static, there would be 
no difference in the way you comprehend my test and 
your favorite texts. The goal of interactive assess- 
ment, therefore, is to discover the conditions under 
which a student will succeed in reading, rather than 
merely describing a student's current status as a 
reader. Moreover, an interactive approach to reading 
assessment will provide the teacher the opportunity to 
assess the instructional factors that influence reading 
performance. 

A comparison of the purposes and uses of assess- 
ment data based on static and interactive assessment 
modes using an informal reading inventory is shown 
in Table 1. 

Interactive assessment using an IRI 

When testing and teaching become integral events, 
the assessment process looks very much like a well 
plenned reading lesson. Below are the steps in admin- 
istering an informal reading inventory interactivety 

(1) Diagnostic interview 

Gather general background information as well as 
imormation about the student's "real world" interests 
through conversation, questions, and with attitude 
and interest inventories. Evaluate the student's aware- 
ness of the goals and purposes of reading. Gather the 
student's descriptions of his/her own reading abilities 
and stratcnies. 

(2) Determining passage placement 

As the student works through the word lists, provicis 
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Table 1 



A comparison of thg purposes and uses of assessm ent In two modes 

Static assessmsnt 



Describe what the student can do on the test 
without mediation 



Interactive assessment 
Describe strategies tried and their effectiveness 



Form generalizations about the student's problems Form generalizations about potential effectiveness 

of strategies for improving the student's literacy 
development 



Derive numbers and levels 

Infer the kind of instruction that might work best 



Derive information about how well the student can 
progress given good instruction 

Acquire dear instructional guidelines based on 
mediation during assessment 



help with difficult words and teach word knowledge by 
exploring various word recognition strategies. Count 
as correct the words learned through teaching 

(3) Preparing to read 

Build motivation for and interest in reading the pas- 
sage. Activate and expand relevant prior knowledge. 
Help set purposes for reading. Preteach necessary 
vocabulary and concepts. 

(4) Reading silently first 

Allow the student to read the passage silently first in 
order to work through miscues that can occur when 
students are requested to read a passage orally with- 
out rehearsal. This practice also provides students an 
opportunity to point out unknown words or confusing 
parts of the text. 

{5) During oral reading 

Mediate word learning and comprehension using a 
variety of strategies. Modol comprehension processes 
with self-questioning and by thinking out loud. Gather 
self-reports from the student on his/her comprehen- 
sion strategies. Use reciprocal teaching strategies 

(B) After reading 

Gather retellings. Allow the student to look up infor- 
mation to answer detail and factual questions. Extend 
the student's understanding of the passage with activ- 
ities that connect prior knowledge and experience 
with newly learned content. 

"Eddfe": Success through 
interaction 

To illustrate the differences between static and interac- 
tive assessment, t will describe an administration of 
an informal reading inventory under interactive condi- 



tions with a seventh-grade remedial reading student. 
Prior to administering the IRI interactively. Beth, the 
reading teacher, had administered one of the forms 
of the inventory in the static mode for comparison 
purposes. 



Diagnostic interview 

"Eddie" came into seventh grade with a long history 
of remedial reading instruction. Beth checked Eddie's 
records and found that he began falling behind in 
reading in the second grade. Recent standardized 
test results had placed him 3 years below grade level, 
and his academic progress had generally been char- 
acterized as slow. 

During the interview, Beth discovered that Eddie 
seemed lo i«» bright, alert, and of above average intel- 
ligence, yet he had always found school difficult. 

The informal conditions of the interview allowed Ed- 
die to talk very openly and freely. He indicated that his 
favorite subject was gym and that he liked math the 
least. He went on to say that his favorite thing to do 
outside of school was lo play baseball. Eddie was a 
pitcher on a little league team. When asked why he 
liked baseball, Eddie replied. "Because if you work 
hard, you can improve" Eddie reported that his other 
big interest was watching mystery movies on his VCR. 
He told Beth that he was proud of the fact that he had 
seen every Sherlock Holmes movie ever made. He 
said he liked to figure out how they were going to end. 

Beth questioned Eddie about his reading habits and 
strategies. When asked if he likes to read, he said he 
did as long as he didn't have to read too much. He 
explained it this way: "I get stuck.... I read two pages 
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then get bored. The beginnings of books are not excit- 
ing, and textbooks put me to sleep." 

When asked about his attitudes toward reading and 
his reading processes. Eddie's responses were very 
revealing. He said the most Important thing about 
reading was "understanding," arid that reading was 
tor learriing and fun. He stated that when he comes to 
a word he doesn't know, he stops, tries to sound it out, 
and If that doesn't work or takes too long, he leaves It 
and keeps reading. When studying his textbooks for a 
test, E<Wie said he goes back and looks at the infor- 
mation he thinks is going to be on the lest and rereads 
the section a few times. He a^Jmitted, however, that he 
sometimes studies the wrong material. 

He said he prefers to read at home rather than at 
school because he can read out loud which enhances 
his understanding, if he doesn't understand some- 
thing, he asks his mom or dad to explain it in a way he 
can understand. 

When asked about his experiences in remedial 
reading. Eddie responded that he didn't enjoy the 
■ class because "they didn't read anything interesting." 

The interview provided Be»h with a rich store of in- 
formation about Eddie. She knew what his interests 
were and dlscov-sred that he had a relatively sophisti- 
cated understanding of the reading process and the 
purposes of reading. She knew with further explora- 
tion she could discover a great deal about Eddie's ac- 
tual strategies during reading and studying and 
provide appropriate mediation. 

Determining passage placement 

Using Johns's Basic Reading Inventory (1985), Beth 
asked Eddie to begin reading the fourth-grade word list. 
With mediation. Eddie was able to proceed through the 
eighth-grade list. Eddie appeared to use sound decod- 
ing strategies, but seemed to lack understanding of 
many of the words on the Isolated lists. To check his 
understanding. Beth framed the words Eddie failed to 
decode in ctoze contexts and asked him to use the se- 
mantic dues to figure out the word, as in the example 
below with a word from the fifth-grade list. 

fiord: drowsy 

wntwi; They hik«J up the mountain path all day. than made 
camp on iht summit Soon attar dinner they were feeling 
and one by one crawled into iheir sleeping bags tor sev- 
eral l»urs ot well deserved steep 

At limes. Eddie would not attend to the middles of 
words saying, for instance, "great" for graduate and 
"competition" for common. In these cases, Beth once 
^ again placed words in semantic contexts and provided 
the beginning and ending letters, as in the following 
examples. 
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In ordtr » 8_jaft trom htgh schod. a Wudent must pass all of 

ftt$ required coursas timugti I2th grade. 

It o r . » to ^ Chn«mas in Chicago. 

This Strategy helped Eddie see that a combination 
of decoding skills can be used to discover word 
meanings. 

Preparing to read 

After seeing Eddie's performance with the word lists. 
Beth had him begin reading the fifth-grade passage. 
Motivation and interest were developed before read- 
Ing each passage. Examples of successful readiness 
strategies follow. 

The fifth-grade passage was about a camping trip. 
Eddie and Beth read the first two sentences together, 
then Eddie was asked to predict what was going to 
happen to the boy in the passage 

Eddie began by recounting his camping experi- 
ences with the Boy Scouts. He said that the boy and 
his uncle in the story would probably fish, hike, cccH 
food on the campfire, and sit around the fire and 
stories. 

With Beth's help. Eddie created a Venn diagram 
(see the Figure) in which his camping experiences 
and predictions were written in on© circle, while the 
other circle was left blank until after reading. When 
the story was finished. Eddie would then fill in the 
other circle with the camping experiences of the boy 
in the story, and compare his experiences and predic- 
tions with the actual experiences of the boy. Where 
the circles Intersected, the experiences that were 
shared by Eddie and the boy would be written. 

Beth also introduced a couple of vocabulary words. 
trudged and bluegill. which were first discussed, then 
used in sentences. 

For the sixth-grade passage about a Halloween 
witch. Eddie and Beth prepared a word web for 
"witches." During this activity, the words sorceress 
and ordinary were introduced. The web was devel- 
oped to a point that could be used later as an outline 
for a written activity. 

For the seventh-grade passage about Native Ameri- 
cans' worship of nature. Beth helped Eddie construct 
a KWL chart (Carr & Ogle, 1987). The chart had three 
headings: what Eddie knew about the topic, what he 
WANTED to find out, and what he learned as a result of 
reading. The first two categories were filled out prior to 
reading. 

Beth pretaught the words worshipped and ceremo- 
nies bv placing them in context and asking Eddie to 
construct definitions. 

These activities provided opportunities to set pur- 
poses, engender interest, and activate and buiid rele- 
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V«nn diagram comparing Eddie's eamping 
expariencra with hit story reading 




vant prior knov\ wdge for the passages. Eddie 
especially enjoyed the word web strategy. 

During oral reading 

After Eddie read the passages silently, he was asked 
to read them out loud. During oral reading, Eddie re- 
read sentences or parts of sentences in order to make 
use of the context. He had no major difficulties with 
the vocabulary, due to the prereading strategies 
Beth used to develop word knowledge and facilitate 
comprehension. 

Eddie's oral reading of the fifth- and sixth-grade 
passage allowed Beth to listen, observe, and question 
his comprehension strategies. When he met the word 
drifted, for example, in the sixth-grade passage, he 
backed up to see if he could pronounce it by using 
context. When this failed, he slowly sounded it out un* 
til he was satisfied, then he continued reading. Beth 
observed that Eddie had no trouble with the more diffi* 
cult words, sorcemss and ordinary, which had been 
pretaught. 

With the seventh-grade passage. Beth noticed that 
Eddie was moving very slowly through the firsl sen* 
tence. While his decoding was accurate, she felt that 
comprehension may have been breaking down. She 
interrupted him and suggested they take turns reading 
sentences and asking each other questions. This pro- 



cedure is similar to the reciprocal teaching strategies 
advocated by Manzo (1968) and Paiincsar and Brown 
(1984). This approach provided Beth an excellent op- 
portunity to monitor Edd>e's comprehension while 
modelling effective strategies. At one point Eddie be- 
came excited when he realized he had answered one 
of his questions from the KWL chart. 

After reading 

After reading each of the passages, Eddie was asked 
to retell what he could remember. Beth asked him 
to fc^us his retellings on ideas as well as imiwrtant 
details. When asked io elaborate on Interpretations. 
Eddie was given the opi^rtunity to scan the passage 
to find specific supporting information. In this way, 
Beth simulated a "genuine" reading and study task. 
Each of the refilings indicated good comprehension 
for both literal and higher level ideas. He provided a 
very rich retelling for the seventh-grade passage, the 
one that he and Beth actively processed together us- 
ing reciprocal techniques. 

To extend Eddie's comprehension, they completed 
activities begun in the preparation phase. For in- 
stance. Eddie was able to note the similarities and dif- 
ferences between his camping trip and the boy's 
camping trip in the fifth-grade passage, as welt as 
check his predictions. Eddie went back to the 
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"wttchos" word web he had created before reading 
ttie sixth^ade passage and wrote in additionai infor- 
mation and Ideas that were found in the reading. In 
this way. he was abte to see how his prior knowledge 
was related to the ideas in the text. For the seventh- 
grade passage, Eddie returned to the KWL chart, and 
with Bath's help finished the learned column. Eddie 
seemed to thoroughly en^oy this activity. A couple of 
questions were still unanswered after reading, so 
Eddie decided he would use the school's library to 
do some research and write out the answers. 



Eddie's reading performance 
assessed in two modes 



Static Interactive 
Reading levels assessment assessment 



Independent 4th grade 6th grade 
instructional 5th 7th 
Frustration 6th 8th 



Comparing assessments 

When comparing Eddie's performance under interac- 
tive and static modes of assessment (see Table 2). 
Beth ot»en«d significant improvement in his use of 
Interactive strategies. Furthermore, Eddie demon- 
strated that with appropriate instruction, he could suc- 
cessfully read materials intended for his grade level. 
More importantly, Beth discovered during assessment 
several specific strategies that helped Eddie improve 
his progress as a reader and learner. 

Conclusion 

Our assessments of high--isk students who are expe- 
riencing reading difficulties need to become more in- 
teractive. Our notions about ability and disability in 
reading need to become more fluid. The clinical 
model of remedial reading that lingers in most reading 
education programs as an artifact from the time when 
neurological and processing deficit explanations for 
reading disability were in vogue should be replaced, 
instead, our diagnostic practices should be consist- 
ent with the best thinking we have about the reading 
process to date. 

For Instance, while research has informed us that 
reading comprehension is influenced by motivation, 
interest, prior knowledge and values, the text, socio- 
cultural factors, and the literacy context, our diagno- 
ses remain largely "deficit driven" (Poplin, 1984). And 
I agree with Peter Johnston (1985) who views such a 
model as ultimately ineffective in that treatments that 
foltow from this diagnosis tend to dwell on the minu- 
tiae of mental operations. According to Wixson and 
Upson (1986), the goal of assessment is not the iden- 
tification of a disability but rather the specification of 
the rand'itions under which a particular student can 
and wilt learn. 

In my own work (Brozo & Brozo, 1988) and my stu- 
dents' work with middle and upper grade low-level 
readers and learning disabled students like Eddie, we 
have found remari^le contrasts in performance on 



the same measures using static and interactive 
modes of assessment. Interactively, teachers and stu- 
dents discover strategies that lead to improved per- 
formance, positive attitudes toward themselves as 
readers, and independent learning. 
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Teaching and learning have always 
been inseparable for me. This was es- 
pecially true recently, when I took a 
graduate course in children's literature while 
teaching third grade. What a perfect opportu- 
nity this was io expand my own perspectives 
about reading, literature, and response to lit- 
erature, by combining my role as teacher with 
that of researcher. 

As an experienced teacher. I was aware of 
the importance of introducing children to a 
wide variety of books and fostering diverse re- 
sponses to literature. My reading program had 
always consisted of a more integrated ap- 
proach than that provided by the basal series 
used in my district. It included abundant op- 
portunities for sustained silent reading of stu- 
dent-selected materials, various writing 
activities, as well as opportunities to listen and 
respond to a variety of literature. 

One of the cornerstones of my program 
was the daily reading of literature to my class, 
because I knew that reading aloud to children 
stimulated their interest and imagination, as 
well as their emotional development and lan- 



guage use (Trelcasc, 1982). In my program I 
selected stories from not only the district's and 
the state's recommended readings in literature, 
but also from my fevorite and my students' fa- 
vorite books. We read everything from Dr. 
Seuss (inspired by an exhibit of his books at a 
local museum) to classic folk and faiiy tales, 
to the light fantasy of Winnie-the-Pooh, to re- 
alistic and historic fiction including Dtar Mr. 
Henshaw and Sarah, Plain and Tall Some 
books we simply read and enjoyed without 
further response, while at other limes, stu- 
dents engaged in various creative and exciting 
responses to literature. Frequently, I solicited 
oral responses, which sometimes took the 
form of lively discussions about books and 
their characters. Readers Theatre (Cullinan, 
1989; Johnson Sl Louis. 1987) and To\t play- 
ing were also favorite ways my students re- 
sponded, particularly when we were reading 
fairy tales and folk tales. The children loved 
performing in front of their classmates or 
audiotaping their scripts so they could listen to 
themselves. Choral speaking (Monson, 
1986a) of fevorite poems by large and small 
groups of children was also popular. After re- 
hearsing a chosen piece, students would de- 
light in performing for other classes. 

Response to literature in my class took 
many other forms. Students enthusiastically 
engaged in art activities related to books we 
read, activities that included wall hangings, 
collages, flannel board retellings (Cullinan, 
1989), and dioramas. Illustrations for stu- 
dents* own book productions (Johnson &. 
Louis, 1987) were also a rich source of re- 
sponses to literature. In addition, children 
loved to recommend books to each other in 
book sharing groups, and by writing reviews 
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of books they had read that we kept in a card 
file for reference by other students. A format 
for book reviews described by Monson 
(1986a) was similar to ours: we included title, 
author, short plot summary, comments indica- 
ting what the student felt was good or not 
good about the book, and a place to note 
whether or not the student reconunended the 
book to others. Students also had opportuni- 
ties to experiment with writing their own sto- 
ries and poems, inspired by books and poems 
they had heard or read. 

Overall, what I was doing as a teacher 
was substantiated by what I was learning in 
my children's literature class. In addition, I 
learned that the concept of response to litera- 
ture included a fecet previously unknown to 
me. One requirement for the course was that 
we read certain books and write about these 
books from a personal perspective, resulting 
in reader response to literature. Our response 
to literature was based on the work of Bleich 
(1978) and Pfctrosky (1982). In preparing to 
respond we addressed three issues: (a) what 
was noticed in the book, (b) how we felt about 
the book, and (c) how the book was related to 
our own experiences. This preparation to re- 
spond was interesting and stimulating and pro- 
moted individual thinking with no "right 
answer"; Bleich's prompts also promoted a 
sense of ownership of each piece of literature I 
had read and written about. 

I wai intrigued by the idea that the proc- 
ess I had engaged in might be valuable in en- 
couraging my own students' interactions with 
literature, while providing opportunities for 
students to go beyond literal levels of thinking. 
I decided to conduct some research in my 
third-grade class by systematically including 
B]eich*s prompts to prepare students to re- 
spond to literature with the activities already 
employed. My purpose was to examine the 
nature of third graders' responses to the litera- 
ture I read aloud. I wanted to know how stu- 
dents would react to Bleich's prompts and how 
their responses to literature would develop 
over the course of the year. I hoped that my 
classroom research would help me better un- 
derstand my students' thinking about literature 



while at the same time foster their ability to 
connect literature with their own lives. 

Reader response and reading 
theory 

In addition to my personal , positive expe- 
rience with reader response, the rationale for 
using this formal in my classroom fit well 
with my view of reading as an interactive 
process, one in which readers interact with 
text to construct meaning based on their back- 
ground knowledge (Adams & Collins, 1985; 
Anderson, 1985; Mason, 1984; Rumelhan, 
1984). One crucial clement of this model is 
that it allows for different imerpretations of 
text depending on what the reader brings to 
the reading. 




fiesponding to Hterature by sharing hov a book 
makes you is one vay students can relate 
tory events to their oten lives. 
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It appeared to me that encouraging stu* 
dents to respond to literature provided the 
framework for this interaction between leader 
and text, and an examination of the literature 
regarding the use of responding to literaturr: in 
the classroom revealed that there was support 
for this approach. As Monson (1986b} imii- 
cated, as early as 1966 the Dartmouth Confer- 
ence papers addressed the importance of 
encouraging personal response to die literary 
experience. In addition, Britton (1979) argued 
for the in^sion of broad, open-ended ques- 
tions about stories rather than piecemeal anal- 
ysis that interferes with comprehension. 

Furthermore, studies focusing on inter- 
mediate and secondary students' responses to 
literatuiY had been reported (Faman, 1986; 
Five, 1986; Galda, 1982; Simpson. 1986; 
Squire, 1964), and investigations examining 
responses across grade levels had been de- 
scribed (Applebee, 1978; Farnan, 1988; 
Hickman, 1981; Purves, 1975). Two studies 
examined responses made by fifth-grade stu- 
dents. Galda (1982) studied oral responses of 
three fifth-grade girls, while Five (1986) con- 
ducted an indepth examination of fifth-grade 
snidents' written responses in literature jour- 
nals. Both investigators gained valuable in- 
sight into then students' development as 
readers. A question resulting from Five's 
study was how can teachers encourage chil- 
dren to take risks when interpreting what ihey 
read. It seemed to me that the prompts used to 
encourage students' response to literature 
would encourage risk-taking in my students. 

Perspectives on reader response 

A foundation for the reader response per- 
spective that guided my classroom activities 
can be found in the works of Rosenblatt 
(1978), Peirosky (1982), Bleich (1978), 
Farnan (1986, 1988) and Simpson (1986). 
Rosenblatt's (1978) view of readers' transac- 
tions with text, i.e., that comprehension of the 
text involves both the author's ^t and what 
the reader brings to it, coincided with my con- 
structivist view of reading. 

Petrosky (1982) suggested that students 
who write about what they read would better 
understand these texts. He further indicated 
that Bleich's (1978) three-part response for- 
mat, described earlier, provided a framework 
through which students were able to represent 
their comprehension in writing and make 
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meaning for themselves. One of the two stud> 
ies reponing successful response to literature 
at the junior high level used Bleich's prompts 
(Farnan, 1986). Faman's reading, thinking, 
and writing strategy (the TAB Activity) was 
similar to the respond probes I adopted. She 
reponed that the TAB activity encouraged her 
seventh grade students to go beyond simple re- 
trieval of information. It encouraged "active, 
reader responses to a work, thereby promot- 
ing comprehension, enjoyment, and cognitive 
development" (p. 20). 

Also at the junior high school level, 
Simpson (1986) employed oral reading ai^ a 
response journal to integrate reading with 
writing and to promote literature. Simpson in- 
dicated that communal sharing of responses 
promoted an appreciation of the contribution 
that each student brought to the event. Fur- 
thermore, critical thinking and active listening 
skills y/cre d^Ioped; and by listening to the 
teacher's oral reading, students were encour- 
aged to read on their own. 

Engaging students to respond to 
literature in my classroom 

All 28 students in my multiethnic third- 
grade class participated in activities that en- 
couraged response to literature. The students* 
reading levels ranged from first to fourth 
grade. Due to the variance in reading abilities 
and because of the success Simpson had en- 
countered. I decided to introduce responding 
to literature by reading a wide variety of liter* 
ature aloud to the class rather than having stu- 
dents read silently. 

I used Bleich's (1978) prompts to encour- 
age response, which included the following: 
(a) What did you notice in the story? (b) How 
did the storv make you feel? (c) What does 
this story remind you of in your own life? 

In the next two sections I will explain how 
I introduced the prompts first as an oral lan- 
guage activity and then as a written activity. 
Following thati 1 will discuss students* oral 
and written responses to literamre, including 
samples of their responses. 

Phase 1- recording oral responses. Be- 
ginning in the fall of the year, I gradually inte- 
grated responding to literamre with the other 
modes of response used in my classroom. In 
this first phase, which took place during Octo- 
ber and November. I read stories to the class; 
and approximately once a week, Bleich's 
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prDii^>U vftTt used in whole-group activities. 
I recorded student responses to each of th2 
promins on sheets of butcher paper, in much 
the same way thai students' words might be re- 
corded in language experience activities. 
These re^xmse charts were then displayed in 
the mom so they could be reread by students. 
Tliis structure permitted students to engage in 
le^xmding to literature without r»]uinng in- 
dividual written responses. It also allowed sni- 
dents to hear each others' thoughts about the 
story, demonstrated that all responses were 
valid and valuable, and showed that there was 
not just one "right" answer. In other wonis, it 
provided a fFameworic and guided practice for 
Amire oi^Tiunities to respond to literature. 

Phase Il'-wriaen responses. In the sw- 
ond phase, which began in January and con- 
tinueid until the end of the school year, I again 
read stories to the class; however, instead of 
students responding orally to the Bleich 
prompts, they had S minutes * -* respond in 
writing to what was read using the prompts as 
8 guide. This initial 5-minute limit was based 
on Faman's (1988) research, indicating that 5 
minutes allowed enough time for students to 
tndividu^ly respond succinctly to each 
prompt, and that timed writing focused stu- 
dents' attention ai^ bolstered fluency. The re- 
sponse time was extended slightly as the year 
pn^s^ based on input from the students. 
By the end of the year, students wrote for ap- 
projumately 7 to 8 minutes. I encouraged stu- 
dents to write for the full time allotment for 
each prompt and told them not to v^rry about 
spelling; Iwwever, because students are often 
slowed in their writing due to their inability to 
spell words, I wrote several words on the 
board common to the stoiy, including items 
such as characters' names. In addition, I circu- 
lated among the students during the writing 
sessions to assist with spelling if a child re- 
quested it. 

Following the writing, students were 
given an opportunity to share their responses 
with the class. This provided a format for both 
speaking and listening. Written responses 
were then collected so that I could read them. 
I did not "grade" responses, but comment«l 
informally as one might comment in response 
to journals. I collected a sampling of these re- 
sponses to include in student ponfolios. Oth- 
ers were returned to students after I duplicated 
them for my files. 



Examination of student responses 

Below I describe two different response 
modes. The f)i^ mode was designed to pro- 
vide practice that fecilitated a smooth transi- 
tion to the next mode. 

Om! responses. Initially, responses I re- 
corded during Phase I were brief and usually 
related only to one incident in the story. For 
example, in October afier listening to Norton 
Hatches the Egg by Dr. Seuss (1940), stu- 
dents' responses, generated from the question 
•What did you notice in the stoiy?" resulted in 
simple descrii^ive statements such as "I no- 
ticed animals making fun of Honon" and 
"Horton sitting on an e^ in a tree.'* A few stu- 
dent gave responses that were more inclusive 
oS the story, such as "The lazy bird didn't want 
to t^e care of the egg until it was hatching." 

The other two prompts evoked similarly 
brief responses. The question "How did the 
story make you feel?" resulted in such answers 
as "Sad because Horton was on the egg so 
long." The third question, "What does this 
story remind you of in your own life?" also 
prompted simple responses such as "People 
teasing me." 

These one-line responses dominated my 
students' initial attempts to respond to litera- 
ture using the prompts. However, as students 
became more familiar with being given the 
opportunity to respond to literaure, their re- 
sponses became more detailed. After listening 
to a version of Cinderella in November, stu- 
dents' responses to the first two questions in- 
cluded the following: 

Response ! 

I noticed when t)» beggar came to the door and 
Cinderella gave htm a piece of bread ami two step» 
sisters ran after the beggar aiKl he &atd 'If only you 
kiKw who ! was* In thebeginning the guy w:as poor 
and he made Cinderella do the work. 

Response 2 

It nwle me fsel lucky because Cinderella had to do 
a tot of work and I feel like I have to do all the 
work. 

Response} 

1 felt happy she got married and lived happily e^r 
after. The book made me feel sad because he 
couldnl find her. 

During discussions of the questions about 
what they noticed and how they felt about the 
books, students often indicated that they 
agreed with other students' responses by say- 
ing. "That was what 1 was going to say." This 
was not the case for the question relating story 
events with their own lives, a question requir- 
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sumnurizing of story events in their «>bserva- 
tions. Despite the fact that in the folio^ ing t%' 
amples both students were reading below 
grade level, they wrote rather sophisticated 
observations about the style of the literature. 
One student pointed out the use of fantasy by 
the author^ whereas another noticed differ- 
ences in the British author's use of language : 
RcspoQSt I 

I mkiced that donkeys can't have birthdays, they 
can't even talk, but it is a book. They can do any- 
tiling they «am. They were imagining things. 

I noticed lh« they spelled some words different in 
tiie book and I noticed that they wrote different in 
the book than we do and pronounced some words 
difiereni and some words wrong. 

One of the interesting things about my 
Students* responses to the prompts about how 
the book made them feel was that they seemed 
progressively more able to put their feelings 
into words as the year passed. This may have 
been due to a gradual improvement in writing 
skills over time, or it may have been due to the 
content of these latter selections that often 
contained events with which students could 
identify. Students frequently noted a range of 
feelings elicited by incidents in the stories. 

Kesponse 1 (responding to Winnie the Pooh. 
Miine. 1926. 1994) 

It made me feel sad when Eeyore felt sad because 
everyone forgot i^x>ut his bitihday. It nude me feet 
happy when Winnie the Pooh gave Eeyore a pot 
that Eeyoiv could use. It made me feel happy when 
he liked the pot. 

Response 2 (responding to Stone Fax. Gardiner, 
1980) 

It made me feel sad because the dog died of a hean 
anack. And happy b^ause he won the sled race 
and nwf because he had to pay taxes. 

ReiponM 3 (responding to Blind Colt, Rounds, 
1941.1960) 

When the blind colt was stuck in the snow, I was 
sad because he was so little and because I like 
horses. And the part where Whit^ sot to keep the 
horse I was happy because he really loved the blind 
colt. 

One Student made an interesting observa- 
tion about the feelings she experienced while 
listening to Winnie the Pooh. She did not refer 
to specific events but to a general feeling 
about the reality of the book: 

h made feel like it was really m front of my fece 
in real, like speaking to me and my classroom be- 
cause it stymied so real to me and I liked it. 

Responses to the question asking students 
to relate the story events to their own lives of- 
ten Ksulted in what Monson (1986b) referred 



to as the emotional reactionr an indication 
that students are making personal responses to 
the story. Students wrote accounts of specific 
events in their lives that were triggered by 
story e>«nts. Some students wrote long, de- 
tailed responses, whereas others wrote brief 
replies. 

Response l(feqxmding to Wimie the Booh) 
When I was five years old and ii was my birthday I 
ih(Nig)H everyone forga my birthday. 1 was mad 
but tney had planned to go to Disnevland and 1 did 
mH know. 1 was mad ami tlwy tricked mt. It was 
great. 

Response 2 (responding to Winnie the Pxh) 
It reminds ine about when my mom (mly bought 
me a cake and we just got to eai a cake and had no 
presents. 

Response 3 (respomling to Stme fox) 
It reminded me of when the first dog I got was run 
over on Halloween night. I cried for two weeks and 
I fell like t was going to die but my mom and dad 
got me a rww dog. Then I felt hapi^ again. 

There were noticeable differences be- 
tween the written responses obtained at the 
end of the year and tho^ otHained earlier. Stu- 
dents' responses displayed increased fluency 
and greater detail, as well as fewer errors in 
sentence structure and spelling. There was ev- 
idence of more summarizing by almost all stu- 
dents in response to the objective question 
about what was noticed in the story. In addi- 
tion, some students made observations about 
the authors style and the use fentasy, which 
had not been noted earlier in the year. Stu- 
dents' responses also increasingly reflected 
emotional involvement (Monson, 1986b) 
when relaying feelings or relating story events 
to their own lives. These changes may have 
been fostered by the reader response activity 
itself, as wll as from exposure to a wide vari- 
ety of literature. 

Closing thoughts 

Giving students the opportunity to re- 
spond to literature added a substantive ele- 
ment to my literature program. BegardHess of 
reading ability all students 3vere successful in 
respondiiig to* literature, guided by the 
'prompts. Allowing students to respond in both 
oral and written formats fostered written and 
oral expression. Itesponding to literature pro- 
moted student'" ibility to connect their prior 
knowledge and experiences with the text; and 
'encouraged personal response to literature. 
By engaging personal responses. I was able (o 
encourage sttidents to go beyond literal retell- 
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ing more personal responses. One student 
said, "It reminds me of when I have to do 
work -housework plus the dishes," whereas 
another ex^ndcd even further about his own 
domestic duties, "It reminds me of when 1 
have to scrub the floor and clean the bath- 
rooms and do the dusting and I have to take 
out the trash." 

In examining responses by students of 
varying reading levels, it was interesting to 
note that all students, regardless of reading 
ability, responded in a meaningful, albeit 
sometimes brief manner, and all were able to 
relate story events to events in their own lives. 
The progressive increase in length and depth 
of responses during the oral response sessions 
may indicate that, as students were learning to 
trust themselves and the teacher, they were 
more willing to contribute their own ideas. 

Written responses. After responding 
orally to literature, we made a transition to re- 
sponding in writing This transition was an 
easy one, perhaps because students were ac- 
customed to thinking about the prompts. Fur- 
thermore, my third graders were easily able to 
respond in writing to the questions within the 
allotted time. 

During the initial transition sessions, stu- 
dents listened to Charlotte's Web by E.B. 
White (1952, 1980). Although an analysis of 
responses showed that the better readers were 
also more fluent writers, all students re- 
sponded to each of the prompts. The follow- 
ing examples of student responses were edited 
for errors in spelling and grammar to facilitate 
understanding- Therefore, analyses of these 
errors will not be addressed in this discussion. 
However, a general statement about improve- 
ments nc^ced over time will be included at the 
end of this paper. 

When I asked students what they noticed 
in Charlotte's Web, those reading below grade 
level were more inclined to focus on one or 
two story events, such as "1 noticed the rat 
named Templeton that took the rotten egg that 
Avery smashed" and "Wilbur bad 3 friends. 
Wilbur won first place. Fern had a brother." 

In contrast, studenu reading at or above 
grade level wrote more summarylikc descrip- 
tions of the story. 
Response 1 

The pitt woo grand prize at Ac feir and the best 
Uiing about the story was when Cbarlotte had some 
babies a«J when they wit flying off in the bal- 
loons. 



I noticed a Im of things in the whole story But a 
the end it was nice because there was 583 little ba- 
bies. It was sad when Charlotte died. 

All Students were successful in connect- 
ing incidents in the story to experiences in 
their own lives. There were fewer differences 
between good and poor readers' responses to 
the question "What does this book remind you 
of in your own life?" One snident reading be- 
low grade level responded with the following: 

It reminded me of when I saw a pig in the mud and 
I thought diat pigs were always clean. And it «• 
minded me of when 1 played in the mud vesterday 
and a girl put a little piece of mud on my hair. 

A grade-level reader was reminded of his 
own day at the hit after listening to a chapter 
in Charlotte's Mb: 

The book reminded me of when I went to the frir 
and won a monkey doll and when 1 went on the 
ferns wheel I stayed on the top and I could see the 
whole &ir. 

When students were asked to write about 
their feelings regarding the book, responses 
were usually longer than those given in the 
oral response sessions, and most students 
elaborate on more than one feeling or single 
event. A typical example of this is seen in the 
following response: "It made me feel sad be- 
cause Wilbur was going to get killed. It made 
me feel happy because Charlotte had 514 
eggs." 

Written responses increased in length as 
students had nore practice with the activity. 
This may have reflected an increase in fluency 
encouraged by the timed aspect of the work; it 
may have also reflected growth ovtr time due 
to practice with several writing activities. 
Otfier changes in response patterns were also 
apparent near the end of the year. Students of 
all reading abilities were inclined to write 
more elaborate summaries to the question 
"What did you notice in the story?" For exam- 
ple, after listening to Milne's (1926, 1954) 
Wmnie the Pooh, a student whose reading per- 
formance was below grade level noted several 
events: 

Eeyorc has a birthday and Piglet was going to give 
EQore a balloon and N was running along to get to 
the lake first ami then Bang He popped the bal- 
loon. RMh was giving Eeyore a poi and he ««m to 
owl to ask him to write happy birthday on it. 

Another change that occurred in written 
responses to this question was that some stu- 
dents went beyond the literal retelling and 
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ings 10 more indepth analyses and emotional 
imcrpretalions of literature. In shon, allowing 
students to respond to what they read or heard 
from a read-aloud provided the framework for 
what Piaget (in Gallagher & Reid, 1983) re- 
ferred to as the active involvement in learning 
through the construction of meaning. 

Students' responses to literature provided 
me with a systematic way to observe and eval- 
uate student interactions with literature. By 
collecting student responses, I was able to 
documem both individual and class develop- 
ment in response patterns oi-er time. More- 
over, on another level, not only were students 
actively involved in both written and oral re- 
sponse modes, they were enthusiastic about 
literature, and their enthusiasm was sustains! 
throughout the year. Overall, responding to 
literature fostered comprehension, discussion, 
and writing skills, and promoted emotional in- 
volvement with and appreciation of literature. 
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I The current national emphasis on developing 
strategic readers who ha^ a command of higher or- 
der thinking skills has American teachers rapidly re- 
tooling their traditional instructional techniques. 
Buzzwords such as scaffolding, zone of proximal de- 
velopment, and metacognition resound in faculty 
rooms and in teacher education programs. 

Students are changing, too. They are learning to 
question their own thought processes as they compre- 
hend text and to refine their higher level thinking skills 
as they more adequately arm tftemselves to face the 
uncertain demands of the 21st century. Classrooms 
seem almost to reverberate with excitement as stu- 
dents engage in active dialogues about meaningful 
text. 

In contrast, down the hall in the remedial reading 
classroom or in the reading groups of many at-risk stu- 
dents, the silence can be deafening. Sometimes the 
teachers of at-risk students assume that techniques 
work only with average readers who have already ex- 
perienced success in reading; they may unintention- 
ally send students negative or "disinviting" messages 
about their chances for success in reading. Just as of- 
ten, perhaps, students themselves learn quickly to 
view themselves as incapable of learning. Caught in 
the failure cycle, these at-risk readers develop their 
own behaviors to cope with their lack of reading suc- 
cess; these behaviors amount to learned helpless- 
ness in the face of repeated failure (LIcht, 1983), 

Research has suggested that once into the learned 
helplessness mode, students develop a passive orien- 
tation to learning (Torgeson, 1982), Direct access to 
metacognitive strategies may help some students 
deal with the cognitive aspect of learned helplessness 
(Cullen & Boersma. 1982). Certainly, students who are 
at risk of reading failure need appropriate instruction 
in reading strategies that will enhance their ability to 
get meaning from text, but just as surely, they need 
techniques that focus on their affective needs to help 
them see themselves as capable learners and good 
thinkers. 

The interactive effect of self-concept and school 
achievement has long been established both em- 
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Thinking through question/response cues 
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3 Recall 
" facts 

plot design 

sequence 
detail 

summary 

Cause < - > Effect 

cause 
effect/result 

motive 
consequence 
inference 
prediction 
hypotfiests 
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Similarity 

analogy 
ratio 
comparison 
intersection 
common element 

Ex Idea to example 

categorization 

deduction 
substantiation 
anal(^ 
supiMrt 



Evaluation 

X ethical consideration 
evaluation 
judgment 
rating 
weighing evidence 
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Difference 

contrast 
comparison 
distinction 
discrimination 
differentiation 

Example to Idea 

classification 
induction 
conclusion 
generalization 
finding essence 
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Tell the sequence of events in "Ransom of Redchief." 

How are the causes of the American Revolution and the Cfvil War simitar? 
What feelings does Pinocchio have that Wilbur also has? 
How is Johnny Dorset like Tom Sawyer? 

How is a rhombus different from a parallelogram? 
How is a mammal different from a reptile? 

What are the effects of teasing? 

What do you think causes a raintx>w? 

What would happen if the earth rotated only once a year? 

Why was Ahab wrong to push after Moby Dick? 

What are some examples of irony in "Ransom of Redchief"? 
From our list of stories, find some examples of friendship. 
Show some examples of the distributive property. 

What are some character traits of Dorothy in 77?e Wizard of Oz? 

What are the themes of Th0 Karate Kid? 

From the evidence, what conclusion do you draw? 

From these examples, make up a rule for use of quotation marks. 

Was Ahab right or wrong to push on after the whale? 
What Is, for ^u. the main theme of The Wizard of Oz? 



piricaify and intuitively The landmark studies of 
Brookover and his associates (1962) have contributed 
evidence of the persistence of the relationship be« 
tween self-concept and school achievement. More- 



over, Brookover and others (Brookover. Thomas, & 
Paterson, 1964; Bruck & Bodwin, 1962; Campbell, 
1967) have concluded that even with IQ factored out, 
self-concept and school achievement correlate signifi- 
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cantly. Studies of the relationship between self- 
conce^ and later reading achievement (Wattenburg & 
Cliftord, 1^) tend to indicate that poor self-concept 
associated with pror reading achievement frequently 
develops prior to. rather than as a result of. reading 
disability. 

Whaidver the causal links may be between self- 
concept and failure in reading, the dear relationship 
tetween the two was sufficient cause to develop a 
model progrrm for readers that had a dual focus of 
Improved performance in reading comprehension and 
enhanced self*concept of the student as a learner. 

Classroom mode) 

A program was develOFM»d for sixth-grade students 
who were classified "at risk" in reading. Six sixth- 
grade students who had received remedial reading 
help in a resource room or special education resource 
instruction for a minimum of 2 years were selected for 
our case study. 

We rea^ned that these students, having experi- 
enced academic difficulties and failure, would have 
relatiN^ly poor concepts of themselves as learners. 
They would be typical of the many at-risk middle 
school students who have experienced a gradual ero- 
sion of enthusiasm for learning, are consistently dis- 
couraged by school because of their academic 
difficulties, and tend to view teachers as being un- 
interested and uncaring (Wehlage, Rutter, & Turn- 
baugh. 19B7). 

The program objective for these at-risk students 
was not only to implement a program to improve com- 
prehension performance, but to have a centerpiece of 
the program elements that would address students' 
ieamed helplessness and enable them to view them- 
selves as competent, capable learners. To that end. 
three elements were selected for the program that 
would give students some overt structure and control 
over their own learning. These elements are question 
response cues, double entry/response journals, and 
self-evaluation. 

Question response cues 

One facet of the program was the use of question re- 
sponse cues, which were selected because they have 
proven to be beneficial in helping students develop fa- 
cility in asking and answering comprehension ques- 
tions. (McTighe & Lyman, 198S). 

Question response cues Bre graphic stimuli that 
represent different question types (Lyman, 1987). 
They can be characterized as a thinking frame of the 
type described by Perkins (1986). who states "A think- 



ing frame is a representation Intended to guide the 
process of thought, sup(»)ning, organizing, and cata- 
lyzing that pnxess. This repf^sentation may be ver- 
bal. Imagistic, even kinesthetic" (p. 6). 

In fact, question response cues are strongly imagis- 
tic and were selected for their potential to give stu- 
dents a concrete framework to act as a compensatory 
tool to help them deal with asking and answering com- 
prehension nuestions. Through direct instruction, stu- 
dents are taught the graphic symbol, the type of 
thinking that may be represented by that symbol, and 
sample questions that exemplify the cue. Cues and 
sample questions are given in Figure 1 . 

Like other techniques that attempt to let students in 
on some of the secrets of comprehension, question re- 
s{X)nse cues are t^t used when taught directly. Then 
each cue is (X)sted in the room so that students have a 
visual thinking frame to help them ask or answer vari- 
ous question types and also aid them in analyzing 
both expository and narrative text. Most important, the 
goal is to give students a thinking frame that enables 
them to have some control over their own learning. 

Double entry/response Journals 

A second component of the program involved the use 
of a modified double entry/response journal. Double 
entry/response journal pages are divided into two sec- 
tions (see Figure 2). The left two thirds of the page 
provides ample room for an initial entry where stu- 
dents can create graphic organizer illustrations, copy 
key words or phrases from a naading selection, or rep- 
licate a cooperative learning group's most important 
comments. The second portion, occupying the right 
third of the page, allows the students to reflect upon 
and respond to the work illustrated on the left. This re- 
sponse portion of the journal also provides a place for 
the teacher to offer his or her comments and re- 
sponses to the journal entry. 

The journal provided opportunities for students' 
writing process to grow as they reflected on their own 
comprehension and metacognitive awareness. Stu- 
dents became conscious of the thinking strategies 
that are appropriate in a particular cognitive task. 
They learned to express the stages of their cognitive 
processing, to plan, monitor, and alter when neces- 
sary. After several months, students' writing began to 
be persuasive rather than simply recapitulating what 
they had done in a reading assignment. 

Teacher comments In the response journals pro- 
vided a critical link to help students monitor their pro- 
gress and to encourage them to view themselves and 
their learning potential in a more positive light. 
T»*»'jher responses, then, were devised to begin to 
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Figurt 2 

Double entry/responss journal sample 



Key wprds or phrases 


Student 




responses 


Cooperative learning team 


Teacher 


comments 


comments^ 




responses 



Figure 3 
Student Journal entry about 
similarities and differences 




Tnis »ntry appffarM m tht teft column ef • douDi* «nt'y/r»spop)M /oumaJ. 



Figure 4 
Student double entry in journal 



Analogies 




Hot is to cold as near is to far 




T^paa. 




(1) Same 


Bitty is to Cody as 


(2) Almost the same 


duck is to hunter 


(3) Opposites 




(4) Part of a whole 




(5) Time sequence 




(6) Category 





eliminate negative self-perceptions by offering affir- 
mations of students' value, by demonstrating the 
teacher's concept that each student possessed po;$i- 
tive attributes often not evident to students them- 
selves, and by indicating the teacher was inviting 
students to become more re^nsible tor monitoring 
their own learning. The response journals, more than 
classroom conversations, created an atmosphere of 
mutual respMt. increasing the likelihood of student 
cooperation and consequently success for the student 
on classroom tasks. 

Figure 3 Shows a typical entry from the left side of 
the dout>le entry/response journal. Through direct in- 
struction students had just been taught the question 
response cues tor similarities and differences and had 
discussed the processes for analyzing similarities and 
differences. They were then instructed to find exam- 
pies of similarities and differences in books they were 
reading. One student, after reading the opening chap- 
ter of a book, decided to compare the main character 
with his antagonist using a)5""5j39[^ as shown. 

On the following day. as^^K^lltteMSnof recognizing 
similarities and differences, this student learned how 
to understand and create analogies. His journal entry 
that day (Figure 4) included an analogy that he had 
learned in class as well as six types of analc^ies he 
wanted to remember. The entry on the right hand side 
of the page was his reflection on analogies and the ap- 
plication of that learning to the material he had read 
and summarized in the Venn diagram. 

Several weeks later, the same student was reading 
Th9 Qraat GiUy Hopkms {Paterson, 1978). Students 
had just learned the question response cue that sym- 
bolized example to idea. The student began to collect 
examples of sarcasm and one day took the entire 
page of his journal to detail in graphic tomi the exam- 
pies of sarcasm h«« had found that related to four of 
the characters. He then reflected on those examples 
and formulated his own idea about sarcasm, which he 
placed in a circle in the center of the graphic organizer 
(Figure 5). 

Self-evaluation 

A third component of the program was selected to en- 
courage students to evaluate their own thinking and to 
enable them to begin to view themselves more posi- 
tively as learners. Through self-evaluation of their 
tasks, students were empowered to take more control 
of their own learning (Costa, 1984). 

Each week students responded to three questions 
about themselves. The first question was "What kind 
of thinker were you this week?" Students responded 
on a 1 to 5 scale, with 1 being poor and S being excel- 
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lent. The next two questions ^^re to be answered in a 
narrative format: "What was the best thing you did this 
week?" "What do you hope to do next weelt?" 

The foltowing example appeared in a student dou- 
ble entry/re5{x>nse journal after the student had made 
his entries following classroom instruction on analo- 
gies. The portion reproduced below indicates the 
teacher's response from the right hand side of the 
journal page followed by the student's response to the 
teacher entry. 

lecher: Jeff, now thai you have twgun to understirKi arN) corrv 
l>totv analogtes. wtiat kind of job do you think you did in TiMsday 's 
tisss'? What kind of Ihinkar mrv you? 
Jtff I was good on Tuesday. I think i was excellent. I was a 5' 

In Jeff's journal entry following his graphic orga- 
nizer on The Great Gilly Hopkins (Figure 5). this dia- 
logue could be read. 

Itocher Jeff, you seteeted many excellent examples of Qiity's 
sarcasm, mcludmg a few i dtdn't write (town m my own journal* 
The idea you created was very thoughtful. Can you extend thai 
and think why Giiiy would be so sarcastic? Perhaps as you read 
further, you witi have another idea What kind of thinker were you 
m your opinion? What dc you hope te do next week? 
Jeff t wasn't as good as I should have been I think I was a 3 But 
next week, maybe I'll be a 5. if I find amMher reason why Giiiy is 
sarcastic I know there is another reason, but I did not want to 
take the time to find out. 

Clearly. Jeff had received positive feedback about 
ttis ideas and was learning to take responsibility for his 
mn learning. 



Conclusions 

Can at-risk learners be instructed in such a way that 
they view themselves more positively as learners? Can 
B program that is designed to enhance o^mprehension 
also enhance self-a>ncept as a learner? Preliminary in- 
dications are that it can. The Waetjen Self-Concept as 
a Learner Scale was administered in September 19B8 
snd again in March 19B9 to the six students. All stu- 
dents viewed themselves more positi^^ly as learners in 
March than they had in September. 

Figure 6 shows the average growth in positive self- 
concept. There were 24 positive "yes" responses on 
the Self-Concept as a Learner Scale ("I usually like to 
00 to school"). Thene were also 24 positive "no" re- 
sponses ("When school is hard, i usually give up"). 

Which of the three program components was most 
important in helping these at-risk students make pro- 
gress in understanding text and in feeling more posi- 
tive atwut themselves as learners? At this point, it is 
Impossible to separate any of the three elements, for 
each contributed. 



Figure 5 
Student journal entry 



Ttetter 

fluff brained religious 

fanatic 
bate of blubber 
dummy 
terrible ogre 
iard face 
hippopotumus 
walrus face 



IV.E. 

retarded 

pretty soon he will be able 
to blow his own nose 
and comb his own hair 

weirdo 

baby 




Principal 

blinking bore 
fool 



Agnes 

Rumpelstiltskin 
snotty little sixth grader 



The cues were important because they provided a 
structure to aid in comprehension. The journals were 
important not only because they encouraged thinking 
through writing but because their very format encour- 
aged reflection on one's own thinking. Moreover, the 
element of teacher response in the journals served as 
a means of scaffolded instruction leading students to 
examine ideas in more depth while giving positive 
feedback about completed assignments. Finally, stu- 
dent self-evaluation placed students squarely at the 
center of their own learning. They learned to monitor 
not only the task itself but their success in achieving 
learning goals. 

If students at risk of reading failure are to overcome 
their learned helplessness, they must indeed learn to 
see themselves as capable of learning and succeed- 
ing. In this program, they did just that. 

If we as educators are to tackle the problem of 
learned helplessness by many of our students who 
are at risk of failure in reading, it will continue to be 
Important for us to address this crucial element of im- 
proving student self-perceptions, for unless they can 
see themselves as capable of tackling a task, their 
chances for success are seriously diminished. Con- 
versely, a program that recognizes the centratity of 
self-concept for all at-risk students and makes provi- 
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Figure 6 
Change In setf^oncept of 
8lxth-grad« a!-rl$k studonts 

in a program promoting 
personal control of learning 
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Pro Fhst Pre Post 

(September) (MaiCh) (Septemt>ef) (March) 
Positive '"yea"' Positive "no'* 

responses responses 



S«(f<onctpt 9vAiutttd &y m» ^»fjtf» StH^ontem «s a iMmtr Scaft {^4 
rvsponi* M usuatf^ Nkt to go to school " Sampto pontfvt "no" rnponaa: 



sion to deal with that central element has taken a giant 
step in the right direction. 
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In 1762, the philosopher Rousseau specu- 
lated that any method of teaching reading 
would su^ice given adequate motivation 
on the pan of the learner. While present-day 
educators might resist such a sweeping pro- 
nouncement, the importance of attitude is nev> 
ertheless widely recognized. The Commission 
on Reading in its summary oi research (An- 
derson, Hiebert, Scott. & Wilkinson, 1985) 
concluded that **becoming a skilled reader re- 
quires... learning that written material can be 
interesting" (p. 18). Smith (1988) observed 
that ''the emotional response to reading... is 
the primary reason most readers read, and 
probably the primary reason most nonreaders 
do not read* (p. 17*^. Wixson and Lipson (in 



press) acknowledge lat "nhe student's attitude 
toward reading is a central factor affecting 
reading performance." These conclusions are 
basMl on a long history of research in which 
attitude and achievement have twen consist- 
ently linked (e.g., Purves & Beach, 1972; 
Walberg & Tsai. 1985). 

The recent emphasis on enhance reading 
proficiency has often ignored the im- 
portant role played by children's attimdes in 
the process of becoming literate, Athey (1985) 
suggested that one reason for this tendency is 
that the affective aspects of reeling tend to be 
ill-defined and to involve "^dowy vanables" 
(p. 527) difficult to conceimialize, measure, 
and address instructionaUy. 

The focus of recem research and develop- 
ment in assessment has b^n comprehension 
rather than attitude. Some progress has been 
made in the development of individually ad- 
ministered, qualitative instruments, but quan- 
titative group surveys, which form a natural 
complement to qualitative approaches, are of- 
ten poorly documented in terms of desirable 
psychometric attributes, such as normative 
frames of reference and evuJence of reliability 
and validity. Our purpose was to produce a 
public-domain instrumem that wcHild remedy 
these shortcomings and enable teachers to es- 
timate attitude levels efficiently and reliably. 
This article presents that instrument along 
with a diK;ussion of its development and sug- 
gestions for its use. 
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Development of the scale 

Several important criteria were esub- 
U^ed to guide tlw development of the instru- 
ment. The authors agreed that the survey must 
(a) have a large-scale normative frame of ref- 
erence; (b) comprise a set of items selected on 
the basis of desirable psychometric proper- 
ties; (c) have empirically documented reliabil- 
ity and validity; (d) be applicable to all 
elementary snidents. Grades 1 dluough 6; (e) 
possess a meaning^, attention-getting, stu- 
dent-friendly response format; (f) be suitable 
for brief group administration; and (g) com- 
prise separate subscales for recreational and 
academic reading. knew of no instrument 
that possessed all of these characteristics. 

A pictorial format was elected because of 
its natural appeal for children and because of 
its comprehensibility by the very young. An 
informal survey of more than 30 elementary 
teachers indicated that the comic strip charac- 
ter Garfield was more apt to be recognized by 
children m Grades I through 6 than any other. 
Jim Davis, who is the creator of Garfield, md 
United Features, his publisher, agreed to sup- 
ply four black-line, camera-ready poses of 
Garfield, ranging from very happy to very up- 
set, and to permit the resulting instrument to 
be copied and used by educators. 

An even number of scale points avoids a 
neutral, central category which respondents 
often select in order to avoid committing 
themselves even when clear opinions exist 
(Nunnally. 1967). The use of four points was 
based on a substantial body of research sug- 
gesting that young children typically can dis- 
criminate among no more than five discrete 
bits of information simultaneously (e.g., Case 
& Khanna. 1981; Chi. 1978; Chi & Klahr, 
1975; Nitko. 1983). 

Several eariier surveys were used as 
models in the creation of an item pool from 
which the final set of items would be con- 
structed {e.g., Esies, 1971; Heathington, 
1979; Right to Read, 1976; Robinson & 
Good. 1987). A total of 39 items were devel- 
oped, each relat«i to one of two aspects of at- 
titude: (a) attitude toward recreational reading 
(24 items) or (b) attitude toward academic 
reading (15 items). To establish a consistent, 
appropriate expectation on the part of the stu- 
dents, each item was worded with a uniform 
beginning: "How do you feel....* 

This prototype instrument was then ad- 
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ministered to 499 elementary students in a 
middle-siz^ Midv^stem U.S. school district. 
For each of the two item sets (recreational and 
academic), final sets of 10 items each were se- 
lected on the basis of inter-item correlation 
coefficients. The revised instrument was then 
administered at midyear to a national sample 
of over 18,000 children in Grades 1-6. Esti- 
mates of reliability, as well as evidence of va- 
lidly, were based on this national sample. A 
complete description id the technical aspects 
of tiM surv^ £q)pears in the Aj^ndix. 

Administering and scoring the 
survey 

The Eementary Reading Attitude Survey 
(ERAS) can be given to an entire class in a 
matter of minutes, but, as with any normed 



Our purpose %ctts to produce a public- 
domain instrument that %s!Ould,.,€nahle 
teachers to estimate attitude le%xl 
efficiently and reliaMy. 



instrument, it is important that the adminis- 
tration reflect as closely as possible the proce- 
dure used with the norming group. The ad- 
ministration procedures are presentol in the 
"DirKtions for Use" information Uiat accom- 
panies the instrument itself. This process in- 
volves first familiarizing students with the 
instrument and with the purposes for giving 
it. The teacher next reads the items aloud 
twice as the students mark their responses. 

Each item is then assigned i, 2, 3, or 4 
points, a "4" indicating the happiest (leftmost) 
Garfield. The scoring sheet that follows the 
instrument can be used to organize this proc- 
ess and record recreational, academic, and to- 
tal scores, along with the percentile rank of 
each. The results are then leady for use. 

Using the survey 

Collecting data about students is an 
empty exercise unless the information is used 
to plan instruction. Scores on the ERAS can 
be helpful in this process, but it is important to 
understand what they can and cannot do as 
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««U as how they rel^ to other sources (tf in- 
formatioii. 

Strengths and limitations. This survey 
provide quantitative estimates of two impor- 
tant aspects of children's attitudes toward read- 
ing. Like global measures of achievement, 
however, th^ can do little in themselves to 
identify the causiN poor attitude or to sug- 
gest instructional tochniqun Ukely to improve 
it. On the (Hher hand, the instruoMnt can be 
used to (a) make possible initial conjecture 
about the attitudes of specific students, (b) 
provide a convenient group profile of a class 
(or a larger unit), or (c) serve as a means of 
monitoring the attitudina] impact oS instruc- 
tional programs. 

A classwomplan. A teacher might begin 
by administering the ERAS during the first 
fiew weeks of the school 3«ar. Class averages 
for recreational and academic reading attitude 
will enable the teacher to characterize the 
class generally on these two dimensions. 
Scores for individual students may suggest the 
need to further explore the nature, strength, 
and origins of their values and beliefs. This 
goal could be pursued through the use of in- 
dividually conducted strategies such as 
structured interviews, open-ended sentence 
instruments, or interest inventories. Reed 
(1979) suggested using nonreactive measures 
as well, such as recorded teacher observations 
following reading instruction and reading- 
related activities. The combination of these 
techniques provides a variety of useful infor- 
mation that can be collected in portfolio Sash- 
ion for individual students. 

Survey results can be v*ry useful in de- 
ciding what sorts of additional information to 
pursue. Four general response patterns are es- 
pecially notable, and we will depict each of 
them with hypothetical students who are, in 
fact, composites of many with whom we have 
worted. 

Two profiles involve sizable differences 
(5 points or more) between recreational and 
ac^emic scores. Jimmy, a third grader, has a 
recreational score of 29 ami an academic score 
of 21 . The difference suggests a stronger atti- 
tude toward reading for nm than for academic 
purposes. To an extent, this pattern is typical 
of third graders (compare the means in Table 
2), but not to the degree exhibited in Jinuny's 
case. Had both scores been higher, Jimmy's 
teacher might have been justified in disregard- 



ing the difference, but a score of 21 is low 
both in the criteria] sense (it is close to the 
slightly frowning Garfield) and in a normative 
one (18th percentile rank). Examining the last 
10 items of the survey one-by-one mi^ prove 
helpful in forming hypotheses about which as- 
pects are troublesome. These can then be 
tested by carefully observing Jimmy during 
riding instruction. 

For Katy, a fifth grader, assume that die 
two scores are reversed. By virtue of her 
stronger attitude toward academic reading, 
Katy is somewhat atypical. Her academic 
score of 29 is quite strong in both a criteria! 
sense (it is near the slightly smiling Garfield) 
and a nonnative set»e (71st percentile rank). 
Her score of 21 in recreational reading atti- 
tude is cause for concern (13th percentile 
rank), but the strong academic score suggests 
that her disdain is not total am] may be trace- 
able to causes subject to intervention. Because 
items 1-10 are somewhat global in nature, it is 
unlikely that scrutinizing her responses will 
be very helpful. A nonihreatening chat about 
reeling habits may be much more productive 
in helping her teacher identify Katy's areas of 
interest and even suggest a book or two. Katy 
may not have been exposed to a variety of in- 
teresting trade books. 

Two other profiles involve differences be- 
tween attitude and abUity. These are very real 
possibilities that require careful attention 
(Roenger, 1980). Consider F&trick, a second 
grader whose academic attitude score is 28 
and who has been placed in a low-ability 
group by his teacher. I^trick's relatively posi- 
tive score (f ^ the smiling Garfield) may en- 
courage hi^ teacher, for it is ^t to be higher 
than others in his reading group. However, 
more than half of his second-grade peers 
across the country have stronger attitudes to- 
ward reading in school. Data from this snjdy 
document a widening attinidinal gap between 
low- and high-ability children as they move 
through school. Patrick's teacher should be 
concerned about the likely effects of another 
frustrating year on his attimde toward instruc- 
tion. Teaching methods and instructional ma- 
terials should be scrutinized. 

Ironically, die same onclusion might be 
reach«i for Deborah, a sixth-grade student ctf 
extraordinary ability. Her academic attitude 
score, however, is only 17, which is quite neg- 
ative, whether one looks to its position among 
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the pictures or notes that it represents a per- 
centile rank of 11. If Deborah's recreational 
score were substantially higher, her teacher 
would be correct in wondering whether the in- 
struction ^e is receiving is adequately engag- 
ing. As with Jimmy, an inspection of her 
responses to items 1 1-20 could be helpful, fol- 
lowed by a noninirusive reading interview and 
tactful observation. On the other hand, sup- 
pose that Deborah's recreational score were 
also 17. This would place her total score (34) 
at the Sth percentile rank and suggest a strong 
disinclination to read despite the ability to do 
so. This would warrant action on the part of an 
insightful teacher who is willing to make in- 
structional and leisure reading attractive. 

Examples of this nature illustrate how the 
Elementary Reading Altitude Survey can enter 
into the process of instructional planning, es- 
pecially near the beginning of a school year. 
As the year draws to a close, the survey can 
again be given, this time to monitor any attini- 
dinal changes of the class as a whole. By com- 
paring class averages from the beginning and 
end of the year, a teacher can gauge the move- 
ment of a class relative both to its own earlier 
position and to a national midyear average. 
Estimating year-long changes for individual 
students is a less reliable process and should 
only be attempted with regard to the standard 
error of measurement for a given subscale and 
gi^ level (see Tkble 2). We recommend us- 
ing twice the standard error to construct an 
adequate confidence interval. In other words, 
the pre/post difference would, in general, 
need to be 5 points or more on either the aca- 
demic or recreational subscale before my real 
change could be assumed. On the total score, 
the pre/post change would need to be 7 or 8 
points. 

Conclusion 

The instrument presented here builds on 
the strengths of its predecessors and. it is 
hoped, remedies some of their psychometric 
shortcomings. Its placement into the public 
domain by means of this article provides 
teachers with a tool that can be used with rela- 
tive confidence to estimate the attitude levels 
of their students and initiate informal assess- 
ment efforts into the role attitude plays in stu- 
dents' development as readers. 



Note: 7^ airfiofs wish to eipwj thtir sincere 
thanks to Jim Davis for his Garfield illusirations 
and for his concern for children^ literacy abilities. 
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ELEMENTARY READING ATTfTUDE SURVEY 

School Grade Name 




2. How do you feel when you read a book in school 
during free time? 




3. How do you feel about reading for fun at home? 




4. How do you feel about getting a book for a 
present? 
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5. How do you feel about spending free time reading? 







6. How do you feel about starting a new book? 







How do you feel about reading during summer 
vacation? 







8. How do you fee) about reading instead of playing? 
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i 9. How do you feel about going to a bookstore? 




10. How do you feei about reading different kinds of 
books? 




1 1 . How do you feel when the teacher asks you questions 
about what you read? 




1 2. How do you feel about doing reading workbook 
pages and worksheets? 
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|17. How do you feel about the stories you read in 
j reading class? 




18. How do you feel when you read out loud in class? 




19. How do you feel about using a dictionary? 




20. How do you feel about taking a reading test? 




student name 

Tfeacher 

Grade 



Elementsfy Reading Attitude Surwy 
Scoring sheet 



Administratloii date 







Scoring guide 


4 


points 


Happiest Garfieid 


3 


pointe 


Slightly smiling Gartiatd 


2 


points 


Mildly upset Garfieid 


1 


p<^nt 


Very upset Garfield 



Recreattonaf reading 

1. 

2. 

3. 

4. 

5. 

6. 

7. 

8. 

9. 

10. 



Academic reading 

11. 

12. 

13. 

14. 

15. 

16. 

17. 

18. 

19. 

20. 



Raw score: 



Raw score: 



Full scafe raw score (Recreattonat Academic): 



Percentile ranks 



Recreational 



Academic 



Full scale 
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Eif mtntary Rtading Attltudt Survey 
Oiiiiettontfof UM 

Tha Elementary Reading AttKude Sum^f pn&vidM a quick indication of student attitudes 
toward reading, ft insists of 20 items and can be administered to an entire classroom in 
about 10 minutes. Each item proMnts a brief, aimply^nted sta^ment aboiA rMding, fot- 
towed by four pictum Garfieid. Each pose to des^ned to depict a different emotional state, 
ranging ftem ^ry pc^itive to very negative* 

AdmifilMfition 

Begin by telling students that you wish to find out how they feel about reading. Emphasize 
that this is nof a test ai^ that there are no '*right*' ansv^rs. Encourage sincerity. 

Oistributd the survey fonns and* If you wish to monitor the attitude (tf specific students* ask 
them to write their names in the a^^ce at the top. HcHd up a c^ of the survey so that the 
students can see the first page. R>int to the picture of QarfieM m the far left of the first item. 
Ask the students to look at this same picture on their own sur^ form. Discuss with them the 
mood Garfield seems to be in (very h^>py}. Then move to the next picture and again discuss 
Garfieid^S mood (this time, a ^ happy), fn the same vmy, move to the third and fourth pic- 
tures and talk about Garfietd's moods^ little upset and very upset, it is helpful to point out 
the position of Garfield's mouth, especially in the middle two figures. 

Explain that together you wilt read some st^ements about reading and that the students 
should think about how they feet about each statement. They should then circle the picture of 
Garfield that is closest to their own feelings. (Emphases that the students should respond 
according to their own feelings, not as Garfield might respond!) Read each Hem aloud siowfy 
and distinctly; then read it a Mcond time while students are thinking. Be sure to read the item 
number and to remind students of page numbers when new pages are reached. 

Scoring 

To score the survey, count four points for each ieftm^ (ha^^est) Qarfieid circled, three for 
each slightly smiling Garfield, two for each mildly upset Garfield, end one point for each very 
upset (rightmost) Garfield. Three scores for each student can be obtained: the total for the 
first 10 items* the total for the second 10, and a composite total The first hatf of the survey 
relates to attitude toward recreational reading; the second hatf relates to attitude towrd aca- 
demic aspects of reading. 

Interpretetlon 

Ybu can interpret scores in two ways. One is to note informally where the score falls in regard 
to the four nodes of the scale. A total score ot SO, for example, would tall about mid-way on 
the scale, between the slightly happy and slightly upset figures, therefons indicating a rela- 
tively indifferent overall attitude toward reading. The other approach is more fomnaJ. It involves 
con^rting the raw sooren into percentile ranks t^y means of 13tt>le 1. Be sure to use the norms 
for the right grade level f nd to note the column headings (Rec » recreational wading. Aca « 
academic reading. Tot - t;>tat score). If you wish to determine the average percentile rank for 
your class, average the raw scores first; then use the table to locate the percentile rank cor- 
responding to the raw score mean. Percentile ranks cannot be averaged directly 
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APPENDIX 

Ibchnlcal aspect! of tlw Eltmantary Reading Attitude Survey 

Vw norming proi9Ct , ^ . ^ . , , . 

Tb crtate norms for ihi InterprBtatlon of scow, a largo-sc«l» stuiJy was conductsd In late 
Januaiy. 1989, at which tima lh« survay was admlnlattfad to 18.138 studtnta in Grwiw 1-6. A 
number of sta^ wwa takan to achlava a sample thai was sufflclentfy stratiflod (I.e.. fwacth* 
d the American population) to allow «>nf}denl ganerallzattoM. Chifdren were drawn from 95 
school districts in 38 U.S. statea. The number of gWs exceeded by only 5 the number of beys. 
Ethnic distribution of the sample was also dose to that of the U.S. population (Sftrttotfca/ §b- 
stmct of th» UnftsU Stales, 1989). The proportion of Blacks (9.5%) was witWn 3% of the na- 
tional proportion, while the proportion of Hispanlcs (6.2%) was within 2*. 

Percentile ranks at each grade for both subscalea and the full scale are presented In Table 
1. These data can be used to compare individual students' scores with the national sample 
end they can be interprated like achlevement-twt |»rcentlle renka. 



Tibial 

Mid-ytar percefitilt ranks by grade and scats 



Raw 

Scr 



Oratf* 1 

Htc *c« Tet 



99 99 
92 91 

99 la 



99 
99 
93 
92 
90 

ss 

98 
94 
92 

80 
Ti 
TS 
72 
89 
88 
62 
59 
99 
92 
49 
48 
43 
40 
37 
34 
31 
29 
29 
22 
20 
18 
19 
13 
12 
10 
9 
7 

e 

9 

s 

4 

3 
3 



Orta* 3 
ff*C *f Tot 



99 99 
94 94 
92 92 



99 
98 
99 
94 
93 
92 
90 
98 
88 
84 
82 
79 
77 
74 
71 
89 
88 
83 
80 
97 
94 
SI 
47 
49 
41 

38 

3S 
32 
29 
28 
23 
20 
18 
IS 
13 
11 
9 
S 
7 

a 

5 
4 

2 



Orad* a 
ffac 4CT Tet 



99 99 
99 97 
94 38 



89 
98 
97 
97 
98 
9S 
94 
92 
91 
89 
88 
84 
81 
79 
78 
73 
78 
87 
84 
91 
S8 
98 
II 
48 
44 
41 
38 
34 
31 
28 
29 
23 
28 
17 
19 
13 
11 
9 
9 
7 
8 
9 

4 



Qraa* 4 

Pae tea Tot 



99 99 
97 99 
95 97 



99 
99 
99 
99 

97 
98 
95 
94 
93 
91 
99 
88 
88 
83 
80 
78 
75 
72 
69 
88 
82 
59 
98 
93 
48 
49 
41 
39 
35 
32 
29 
29 
23 
20 
18 
18 
13 
12 
10 
9 
7 
8 
8 



Oratfa 8 
Bag *oa Tot 



99 99 
99 99 
98 98 



99 
99 
SS 
BS 
SS 
SS 
S7 
S7 
SS 
SS 
84 
S2 
91 
89 
87 
84 

sa 

7S 
78 
73 
70 
87 
84 
81 
97 
S3 
50 
48 
42 
39 
39 
33 
29 
29 
23 
20 
17 
19 
13 
12 
10 
9 
8 



Orada 8 
Wae 4c« Tot 



89 
89 
99 
99 
99 
99 
99 
99 
98 
97 
99 
99 
93 
92 
90 
99 
88 
84 
82 
78 
78 
73 
89 
98 
82 
58 
89 
92 
48 
44 
48 
37 
33 
30 
27 
29 
22 
28 
17 
19 

99 99 13 
98 99 12 
97 99 10 
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88 
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98 
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39 


17 
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1 


78 


81 
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81 


88 


3 


84 


90 


3 


87 


88 


4 


88 


87 


8 


34 


72 


•98 


1 


74 
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79 


83 
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78 
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82 


93 
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83 


99 
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3 3 


6S 


83 
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68 


73 
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88 


78 
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72 


83 
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78 
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88 
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82 
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83 


74 
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79 
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at 
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93 
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98 
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97 


99 
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79 
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88 


82 
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69 


87 
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49 
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90 


87 


0 


91 


83 


0 


94 


70 


1 


98 


77 


1 


63 


82 


2 


2f 


38 


44 


0 


44 


#1 


0 


49 


98 


0 


47 


84 


1 


83 


71 


1 


98 


78 


1 


21 


32 


38 


0 


37 


48 


0 


38 


93 


0 


41 


88 


1 


48 


88 


1 


91 


73 


1 


2T 


28 


'14 


0 


31 


41 


0 


33 


47 


0 


38 


S2 


1 


42 


80 


1 


48 


87 
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2t 


21 
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28 
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28 


41 
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94 
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39 


60 
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17 
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20 


32 
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21 


38 
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23 
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34 
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19 
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17 
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49 
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11 
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13 
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1 f 


0 


2 




0 


2 




0 


3 
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1 3 
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1 
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1 2 
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0 




0 
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1 
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1 
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1 




1 1 
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0 
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0 
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8 




0 


0 




0 


0 




1 0 


J- 


9 




<J . 


0 




0 






9 






9 






0 


a 





Crontach's alpha, a statistic deraloped pHmarily tp mtasure tht internal conslstancy of attn 
tude $ca^ (Cronbach. I95i), was calculated at each grade level for both sutecales and for the 
composite score. Th^ coefficients ranged from .74 to .89 and are presented in Table 2. 

tt is interesting that with only two exceptions, coefficients were .90 or higher. These were for 
the recreational subscale at Grades 1 and 2. ft is possible that the stability of young children's 
attitudes toward leisure reading grows with their decoding ability and familiarity with reading 
as a pastime. 



IMea 

DmHpttve ttBtiftics and {fttsfnst Mnslsttnqr mesturte 





M 


SO 


8«M 




80 


8.M 


Alph* 


M 


80 


8«M 




1 


2.918 


31.0 


8.7 


2.9 


.74 


30.1 


6.6 


3.0 


.61 


61.0 


n.4 


4.1 


67 


2 


2.S74 


36.3 


9.7 


2.7 


.76 


26.8 


6.7 


2.9 


.61 


6S.1 


11.4 


3.8 


.86 


3 


3.tSt 


30.0 


9.6 


2.9 


.60 


27.6 


6.4 


2.8 


.61 


97.8 


10.9 


3.6 


66 


4 


3.679 


29.9 


9.6 


2.4 


.83 


26.9 


6.3 


2.8 


.63 


86 9 


11.0 


3.6 


.86 


8 


3.374 


26.9 


8.1 


2.3 


.66 


3S.6 


60 


2.9 


.62 


94.1 


10.6 


3.6 


.66 


6 


2.442 


27.9 


6.2 


2.2 


.87 


24.7 


5.6 


2.9 


.81 


62.9 


10.6 


3.9 


.69 


All 


16.138 


29.8 


9.6 


2.9 


.82 


27.3 


6.6 


2.7 


.83 


86.6 


11J 


3.7 


.66 



*C/ontech*s alpha (Cfenb^ iSSt). 
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VbtiOty 

Evtdonc* of obstruct validity was gathered sevaral maana. Fqr tha racraational sut>- 
scata, students in tha national nonning group vvara aakad (a) whathar a put)ltc llbraiy waa 
avaii^rta ro ttmm and (b) v^thar thay nrrmtly had a library card* Thoaa to whom iibraiiaa 
mm avaiiabia wa^ saparatad in^ two grou|» (tttoaa witti and without carda) and thair racraa- 
tional scoTM wara comparad. Cardholdafs had atgnificantly higher (p < .00i> racmationat 
scoras [M m than noncardholdara {M m w^iim^ of tha subacala'a vatidtty in thtt 
scorm varied predictably with an outaida critarion. 

A aacond test companNf atuttoni^ who prawntty had books checked mit from their actm)l 
library versus studanta who did not* Tha ct^nparfson was limited to children wims taachara 
repofted not requiring them to check out books. The means of tt^ two groupa varied signifi- 
cantty (p < .001), and children with books checked out scored higher {M - 29.^ than those 
who had no books checked mA[M m 27.^- 

A further teat of tha recnraticmal subscaie compared studenta a^ reported wattrhing an 
average of teaa than 1 hour of Mission per night with studanta who r^iorttd ^ratohing more 
than 2 hours per nigm. The recreation^ mran the low lateviewtng group (31 .5) aignifi- 
camly Mcaedad ip < 00\) the mean of the heavy ttf eviewing group (^.6). Thus, the amount 
of television watched varied invenwiy with children's attitudes toward recreational reading. 

The validity of tha academic subscaie was tMtad by mamining the ratationahip of scoras to 
raading ability. Itohers categorizad nom^gmup children as having tow, average, or high 
overall reading ability. Mean aubacate scores of the high-ability rsaders {M » 27.7) signifl* 
cantly exceeded the mean of low*abiifty readers (M « 27.0, p < .001), evidence that s^as 
wera rafiecttve of how the students truly felt about reading for academic purpoaM. 

The mtationship t^twaen tha aubscalea waa also investigated. It was hypothesized tttat 
children's attiti^es toward recreational and acadamto reading would ba moderately but not 
highly conelated. Facility with raading is likely to affect these two areas similaily, raaulting in 
similar anituda scoras. Nevertheless, it is easy to imagine childnsn prone to read for pleasure 
but disenchanted with assigned reading and children acadamicalty engaged but without inter- 
eat in reading outside of schoc^. The intarsubscala correlation coafficient was .64, which 
meant that Juat 41% of the variance in one set dl scorn coukl be accountad for by the othan 
it is rsaaonabia to suggest that tha (wo subu^ea, while related* also rafiect dissimflar fee- 
tors^a desired outcome. 

Tb tell more precisely whether the traits measured by the survey corresponded to the two 
subscales, factor analyses were conducted. Both used the unweighted least squares method 
of extraction and a varimax rotation. Tha first analysis permitted factom to be identified liber* 
tily (using a limit equal to the smallest aigenvatue greater than 1). Thrae Actors were IdentI* 
fied. Of the 10 items comprising the academic subscaie. 9 loaded predominantly on a single 
^or whila the lOth (item 13} ioadad naarfy equally on all three factom. A second factor waa 
dominated by 7 items of the racraational subscaie. while 3 of the recreational items (6, 9, and 
10) loaded principally on a third factor. TheM items dkl, however, load more heavily on the 
second ^racreatk^nal) fMt<^ than m the f>rst (acadamfc). A second analysis constrained the 
Njentification d factors to two. This time, with one ^ceptlon, all itema Ioadad cleanfy on fac- 
tors associated with the two subscalee. The exception waa item 13, which could have been 
interpratad as a n»craational item and thus apparently fnvoNed a slight ambiguity. l]iken to- 
gether, the factor anatysM producad evidence sortremety supportiw of the claim that the 
Sunday's two subscalee reflect discrate aspects of raading attitude. 
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■ Reading diagnosis today is at a crossroads. There 
has been a general outcry for changes in the way m 
assess a student's reading ability (Caldwell, 19B5; 
Henk, 1987; Leslie, 19S7; Paratore & Indrlsano, 19B7; 
Valencia & Pearson, 1987). Former diagnostic tools 
such as the Woodcock Reading Mastery Tests 
(Woodcock, 1973) and the host of informal reading in- 
ventories— such as the Analytic Reading inventory 
(Burns & Roe. 1985), the Classroom Reading Inven- 
tory (Silvardi. 1986), and so on— that were once the 
mainstay of reading diagnosis in the Chapter 1 and 
learning disabilities classrooms no longer yield the 
type of information necessary to plan an appropriate 
instructional program. As Henk (1987) succinctly puts 
it: "They no longer embody state of the art knowledge 
of the reading process" (p. 861). 

Perhaps nowhere is a change in reading diagnosis 
needed more than in secondary (junior and senior 
high) reading. In our work with secondary problem 
readers, we have been consistently frustrated in our 
attempts to use traditional reading inventories to diag- 
nose our students' strengths and weaknesses. 

Because many of our students read at only a fourth- 
grade level, we need information that goes beyond 
their sight vocabulary level, oral reading miscues, 
ability to decode nonsense words, and literal compre- 
hension—alt that the traditional diagnostic tests yield. 
In addition, there is little resemblance between these 
texts and the reading required of seconda^ students 
in either passage characteristics or task demands. 

While using content reading inventories (Carvell. 
1980; Readence. Baldwin. & Bean, 1981) was a move- 
ment in the direction of ecological validity, we felt that 
this did not sufficiently address some of the funda- 
mental processes of reading— use of prior knowledge, 
ability to establish cohesion through use of text struc- 
ture, and inferencing, for example. W& therefore de- 
cided to construct an inventory that would be 
appropriate for secondary problem readers and more 
accurately reflect the reading process. 

Recent research has led to a definition of reading 
as a constructive process whereby meaning is ob- 
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Figure 1 

Passage and hierarchical outline 



Ibxtbook excaipt 

Long before the pyramid age in Egypt, a king who died was buried in a shallow grave on the edge of the 
desert. Over the grave was piled a mound of sand. Ysars later, the Egyptians built grave mounds in the shape 
of a low box, using wockI, r^s, and sun-baked brick. After some time, stone was used for the boxlike tombs. 
Then tombs o^r the graves began looking like pyramids. The first pyramids are known as step pyramids 
because each side looked like a flight of steps. The true pyramid of the pyramid age had a square base; the 
sides were triangles that joined at the top. 

The Egyptians believed that if a dead person's soul or spirit was to live forever, it must be able to return to 
Its body. It was. therefore, important that the body be preserved. The Egyptians soaked the body in certain 
chemicials which kept it from decaying. Then they carefully wrapped it from head to toe in yards of linen cloth. 
A body present in this way is called a mummy. 

Hienrchical outline of the excerpt 

1 . Stages in the development of Egyptian pyramids (inferred); 

a. A mound of sand over the grave on edge of desert 

b. Mound replaced by low box of wood, reeds, and bricks 

c. Stone used for box 

d. Finally, pyramid shape developed: 

(1) first, step pyramids 

(2) in pyramid age, pyramid had square base, triangular sides joined at top 

2. Egyptian belief that a soul must be able to return to its body (reincarnation) led to preserved body called a 
mummy. 

a. Two steps in making a mummy: 

(1) soak body in chemicals 

(2) wrap it in linen 



tained through the interaction of several factors such 
as text characteristics, reader characteristics, and 
task demands (Anderson. Hiebert. Scott, & Wilkinson, 
1985, Wixson & Lipson, 1984). If the above factors are 
central to the process of reading, they are also central 
to the process of diagnosis and need to be accounted 
for in any inventory that attempts to evaluate reading 
ability. 

In this article we will discuss guidelines for the con- 
struction of an informal inventory that focuses on text 
and reader characteristics and task demands and wilt 
give examples from a sample Inventory. Then we will 
demonstrate how the inventory could be used to plan 
an instructional program by examining the responses 
of two junior high school problem readers. 

Guidelines for developing an 
informal inventory 

(1) Text characteristics. The first task in the construc- 
tion of an inventory is to consider the type of text to be 
used. We follow Johnston (1983), who has identified 
three text characteristics: content, structure, and lan- 
guage. 



(a) To control for these three characteristics, we 
suggest taking intact passages of 500-700 words from 
school textbooks, as opposed to writing special pas- 
sages for the inventory. In this way. the content and 
language typically encountered by the students wilt be 
accurately reflected. 

(b) We also recommend selecting passages that 
use obvious structures and are lengthy enough to de- 
velop these structures adequately. R>r example, in our 
sample inventory we selected a 700-word passage on 
the Egyptian pyramids from a junior high world history 
book. This passage was organized in two parts, with 
the first giving a general description of pyramids and 
mummies and the second describing the building of 
the Great Pyramid. Both passage parts used a cause- 
effect/chronological structure. 

(c) Finally, we recommend that the teacher make a 
hierarchical outline in order to determine the pas- 
sage's organization, main ideas, and supporting de* 
tails. This outline will t>e used for several tasks in the 
inventory. (See Figure 1 for an example.) 

(2) Reader characteristics. The second step is to 
look at the characteristics of the students who will be 
reading the selected passages. To identify the charac- 
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Figure 2 

Samples of tasks that assess students* ability to perceive causal chains 



Identification of anaphoric rafarants 

1. Tim Egyptians t>eliev9d that if a dead person's soul or spirit was to live forever, ft must t>e able to return to 
Hsbody. 

2. The Egyptians soaked the body In certain chemicals which kept it from decaying. 

3. A body presen/ed in tfiis way is called a mummy. 

Quattlons requiring inference from text 

1 . Name three ways graves were made before the pyramids. 

2. Name the two steps In making a mummy 



toristics of secondary problem readers, we suggest 
using the description of the Stage 3 reader as given in 
Chairs (1983) stages of reading development. 

Chall labels Stage 3 as the "Reading to Learn the 
New" stage. According to Chall. Stage 3 is character- 
ized by a reader who brings prior knowledge and the 
beginnings of a conceptual vocabulary and experien- 
tial background to the reading task. While to some de- 
gree this could be said for alt readers, it is particularly 
applicable to secondary readers, who spend a high 
percentage of their time with content area textbooks in 
which the importance of background knowledge and 
conceptual vocabulary increases. 

With this description as a backdrop, the secondary 
teacher needs to determine the adequacy of the stu- 
dents' background for the reading tasks. What prior 
knowledge do they bring? Mow accurate is it? Is their 
conceptual t«cabutary sufficiently developed to han- 
dle the passage? 

We suggest using two tasks. 

(a) Revealing prior knowledge through brainstorm- 
ing: in a brainstorming activity, the students are asked 
to tell as much as they can about the central concepts 
of the passage (as identified in topic statements and 
main ideas in the hierarchical outline). i=or example, in 
our sample inventory the brainstorming questions fo- 
cused on the development of the pyramids, reincarna- 
tion, and the process of making a mummy. 

(b) Defining related vocabulary: For a vocabulary 
task, the students are asked to give oral or written def- 
initions of words specific to the passage, tn our sam* 
pie Inventory we asked students to give definitions for 
19 content words such as //nen, mummy, and decay. 

(3) Task (temands. We now need to take into ac- 
count the task demands. What are the tasks required 
of these students in their content area classes? What 
are the processes necessary to accomplish these 
tasks? 



Chall (1983) describes the tasks of the Stage 3 
reader as "learning how to learn from reading... they 
need to learn a process, how to find information in a 
paragraph, a chapter, or a book" (pp. 23-24). 

(a) Identifying main ideas: One strategy that is es- 
sential in this learning process is the use of text struc- 
ture to identify the main ideas of a text (Armbruster & 
Anderson, 1982; Kintsch & van Dijk. 1978; Me^er, 
1975). We suggest assessing students' use of this 
strategy through either oral or written recalls. The 
teacher compares the student's recall to the hierarchi- 
cal outline, noting the numt>er of main ideas given and 
the use of organization. 

(b) Establishing cohesion: A second strategy neces- 
sary in the learning process is the establishment of 
the cohesive relationship or causal chain annong the 
various text statements (Warren, Nicholas, & 
Trabasso, 1979). This usually requires the use of infer- 
ences on the reader's part. 

Two tasks are useful in assessing student ability to 
establish this causal chain, (i) The first is an anaphoric 
referent identification task (detecting words that refer 
back to other words in the text, e.g.. pronouns). Can 
the students identify the antecedent, thus linking two 
pieces of text? (ii) The second task is a series of infer- 
ence questions that would require the student to inte- 
grate two or more pieces of text. 

in the sample inventory we used six anaphoi^ that 
referred back to major Ideas. Students were asked to 
identify the referent in each case. We also wrote six 
inference questions based on Pearson and Johnson's 
(1978) question/answer relationship taxonomy 

See Figure 2 for examples of anaphora tasks and 
inference questions. 

To summarize, we suggest that in constructing a 
reading inventory for secondary problem readers, the 
secondary teacher should (1) use text that is repre- 
sentative of the texts encountered by junior and senior 
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high students, (2) »)nsider the reader's stage of read- 
ing development, and (3) tap the various strategies a 
student must use to understand the text. 



Examples In Junior high 

Perhaps the best w& t to demonstrate the effective- 
ness of this of iiiventory in instructional planning 
is to examine the results obtained by administering it 
to two junior high students. Both had been identified 
by their teachers as having reading problems and had 
been placed in a special language arts class. "Bob" is 
a seventh grader, and "Barb" is an eighth grader. 
Their responses wi^i be discussed according to each 
section of the inventory. 

Prior knowledge assessment— brainstorming task. 
Bob's responses to the brainstorming task revealed 
some general prior knowledge about the Egyptian pyr- 
amids. He knew that they were built a long time ago 
and that kings were buried in them. He made no men- 
tion of the stages in pyramid development nor did he 
describe anything about mummies. 

Barb a)uid give only one statement for this part of 
the ins^ntory. She said that the Egyptians believed in 
cats and dogs. In analyzing her response, we decided 
that this statement was a misinterpretation of the fact 
that Egyptians worshipped cats. Apparently, she was 
using i>elief as a synonym for worship and overex- 
tended the concept of animal worship to include dogs. 

^or knowlect^ assessment^vixabulary task. Bob 
was able to define 10 of the 19 content vocabulary 
words correctly For 4 of the words he was not able to 
give an exact definition but instead associated the 
word with its semantic network. For example, he de- 
fined chemicals as "pollution" and 2600 B.C. as "be- 
fore time." Me was not able to give any definition at all 
for 5 of the words. 

Barb defined 8 of the words correctly. Like Bob. 
many of her definitions were related to the words' se- 
mantic networks but were inaccurate or vague. A no- 
bleman was defined as "a fighter," 2600 B.C. was 
defined as a "year." One of her definitk)ns appeared 
to be based on some inappropriate prior knowledge: 
She defined mummy as a "monster." This definition 
appears to be derived from late night horror shows 
and, while accurate in that context, could interfere 
with understanding the word's use in the context of 
the passage. She gave no definitions for 5 of the 
words. 

Text structure assessment. Bob did not include any 
main ideas in his summary. He was able to list the two 
steps for making a mummy, but he never identified the 
process as such. The rest of his summary consisted of 
various facts from each part of the passage. However, 



the facts were not related to any of the main ideas. Hs 
did appear to notice that the passage was organized 
into two parts. The first part of his summary related to 
the pyramids and mummies, while the second part fo- 
cused on the building of the Great Pyramid. 

Barb did not include any main ideas in her sum* 
mary. either. Her summary fMused on objects found 
in the pyramid. Unlike Bob, she did not appear to no- 
tice the two parts of the passage: she did not inclu(te 
any information from the second part. 

Cohesion assessment^anaphora task. Both stu- 
dents answered only one item on the anaphora task 
«)rrectiy. This was the sentence that used a pereonal 
pronoun in the targeted anaphora The other ana- 
phoric substitutions were expressicns such as "this 
way" or the pronoun "one." It would appear that nei- 
ther student was familiar with any type of ane^horic 
reference other than a personal pronoun. 

Bob's strategy in identifying the anaphoric referent 
was to use the main verb of the sentence. This oc- 
curred in three of his four errors. Barb appeared to 
misunderstand that an anaphoric substitute refers 
back to something previously stated. In three of her 
four errors, she identified as the referent a noun that 
came later in the sentence. 

Cohesion assessment'^nferencing task. Bob an- 
swered three of the seven inference questions cor- 
rectly His incorrect answers appeared to stem from 
an overreliance on unrelated prior knowledge or com- 
mon sense When asked to name three ways graves 
were built before the pyramids, he responded "by 
hand and by shovel." Similarly, when asked who built 
the Great Pyramid, he responded "lots of men." Both 
answers were literally correct but were not derived 
from the text. 

Barb also answered three inference questions cor- 
rectly However, she also gave partially correct an- 
swers to tv^ additional ones. She named only one 
way graves were made before the pyramids and iden- 
tified only one step in making a mummy She was evi- 
dently either failing to realize that the questions 
required two-part cnswers or failing to link the neces- 
sary pieces of text. 

Instructional implications 

After examining wh?t these students did, the next 
question is what shouivl the teacher do? Is the inven- 
tory helpful in planning an instructional program? The 
answer would appear to be yes. 

To judge from their responses on the inventory, it 
would appear that the students have inadequate prior 
knowledge and vocabulary to handle the text. Before 
they can read their text, their teacher will have to 
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spend consltteraWe instructional time developing their 
background knowledge, perhaps through activities 
such as brainstorming and semantic mapping (John- 
son, Pittelman, & Heimlich, 1986). Both students will 
need help in developing the specificity of their vocabu- 
lary. A definition framevwrk that identifies the cate- 
gory, descriptors, and examples of a word such as the 
one developed by Schwartz and Raphael (1985) 
would be helpful in this area. 

Both students have difficulty In identifying text 
structure and using it to identify main ideas, although 
Bob has at least shown signs of a rudimentary knowl- 
edge. Reading-writing procedures such as hierarchi- 
cal summarizing, cooperative summarizing, and 
content mapping fTaylor, 1986) would be helpful in de- 
veloping student use of text structure. 

Both students showed little knowledge of anaphora 
other than personal pronouns. Instruction in other 
types of back reference using techniques developed 
by Infvln (1986) and Baumann (1986) is crucial to help 
these students establish cohesion. These techniques 
use a direct Instruction model to provide the student 
with explanations about the types and purposes of 
anaphora as well as guided practice in identifying an- 
aphoric substitutes and their referents in the context 
of the students' actual text. 

Finally, both students need to acquire additional 
strategies to answer inference questions. Teaching 
them the OAR (question-answer relationship) strate- 
gies developed by Raphael (1986) would be of benefit. 
As students are guided to analyze and create ques- 
tions through OAR strategies, they become aware that 
some questions are answered directly in the text; 
other questions require thinking, searching, and con- 
necting ideas; and still others can be answered by re- 
lating their own knowledge to information provided by 
the author. 

In conclusion, we feei that we were successful in de- 
veloping an informal inventory that was more sensitive 
to the reading abilities of our secondary problem read- 
ers, both in the type of text used and the task de- 
mands. By following our outline, a secondary reading 
teacher could construct a similar Inventory on the 
texts used In his or her particular school. 

The results that we obtained from administering this 
Inventory to junior high students have demonstra- 
ted that It was useful in diagnosing the students' 
strengths and weaknesses and, consequently, in plan- 
ning an appropriate instructional program for them. 

We began by stating that reading diagnosis is at a 
crossroads. We hope we have been successful in de- 
scribing one appropriate path to take. 
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